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AN  INVESTIGATION  INTO  THE  MARKET  STRUCTURE 
OF  THE  FOREIGN  TECHNOLOGY  DIVISION 


* •  Int  roduct ion 


I h tf  Problem 

The  objective  of  this  research  was  to  identify  and 
evaluate  the  needs  and  requirements  of  users  of  Scientific 
and  Technical  (SfjT)  intelligence.  Relatively  few  government 
agencies  have  implemented  marketing  programs  that  identify 
consumer  needs  and  requirements.  The  present  climate  suggests 
that  the  benefit  of  marketing  research  applied  to  government 
agencies  can  save  resources  and  tax  dollars.  Specifically, 
services  provided  by  the  Foreign  Technology  Division  (FTD),  an 
organization  within  \ir  Force  Systems  Command,  have  been  exa¬ 
mined.  The  Foreign  Technology  Division  is  the  recognized  expert 
in  collecting  and  producing  Scientific  and  Technical  intelli¬ 
gence  for  the  U.S.  Air  Force.  A  further  objective  of  this  study 
was  to  derive  a  characteristic  profile  of  the  users  of  FTD- 
produced  intelligence.  These  profiles  can  be  used  to  make 
recommendations  to  direct  the  production  process  and  create  an 
effective  match  between  consumer  preference  and  product.  An 
added  benefit  of  the  study  is  knowledge  of  the  factors  that 
characterize  satisfied  and  dissatisfied  customers.  User  confi¬ 
dence  in  FTD-produced  documents  can  be  observed  and  validated. 
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Defense  Intelligence  Agency  Manual  7S-1,  Scientific  and 
Technical  Intelligence  Production,  establishes  procedures  for 
the  management,  processing,  producing  and  reporting  of  S6T 
intelligence  within  the  Department  of  Defense.  The  mission, 
goals  and  objectives  of  FTD  are  for  official  use  only  and  can 
be  found  in  FTD  regulation  23-3,  Organization  and  Mission. 
However,  the  basic  philosophy  of  FTD  is  to  reduce  uncertainty 
for  their  users  by  supplying  timely  and  relevant  scientific  and 
technical  intelligence  data.  This  policy  influenced  them  to 
study  their  product  and  its  relevancy  to  the  consumer.  Thus, 
FTD  ant!  its  service  were  the  prime  considerations  of  this  re¬ 
search  c f  for t  . 

A  by-product  of  this  study  is  the  identification  to  the 
Office  of  Management  and  budget  the  validity  of  the,  service  FTD 
provides.  FTP's  fiscal  year  1980  budget  was  cut  along  with  an 
approximate  81  cut  in  all  DOD  Sf,T  intelligence  programs.  This 
loss  of  funds  was  a  driving  force  in  the  implementation  of  this 
research . 

The  basic  focus  of  this  research  was  the  identification 
of  the  specific  needs  of  the  FTD  consumer.  A  recent  audit  of 
FTD  by  the  Defense  Audit  Service  discovered  excessive  delays 
in  processing  formal  requests  for  Sf,T  intelligence  information 
as  well  as  some  dissatisfaction  among  users.  FTP'S  Plans  Sec¬ 
tion  (XOX)  developed  a  questionnaire  (with  advice  from  the 
Department  of  Systems  Management  (ENS)  ,  Mr  Force  Institute 
of  Technology)  to  aid  in  identifying  problem  areas.  A  detailed 
discussion  of  the  SQT  intelligence  users'  questionnaire  can  be 
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found  in  Chapter  III.  The  survey  in  itself  was  an  immediate 
vehicle  for  improving  the  communications  process  between  FTD 
and  the  consumer  (sec  Appendix  A). 

The  Product 

The  JCS  Pub  1  defines  Scientific  and  Technical  intelli¬ 
gence  as: 

The  product  resulting  from  collection,  evaluation, 
analysis,  and  interpretation  of  foreign  scientific  and 
technical  information  which  covers:  (a)  foreign  develop¬ 
ments  in  basic  and  applied  research  and  applied  engineer¬ 
ing  techniques;  and  (b)  scientific  and  technical 
characteristics,  capabilities,  and  limitations  of  all 
foreign  military  systems,  weapons,  weapon  systems,  and 
material,  the  research  and  development  related  thereto 
and  the  production  methods  employed  for  their  manu¬ 
facture  (9 : 289]  . 

It  is  apparent  from  this  definition  that  the  intelligence  pro¬ 
duct  to  be  evaluated  is  multifarious.  FTP  annually  produces 
over  139  documents  to  satisfy  mission  requirements.  They  also 
produce  a  weekly  intelligence  bulletin  and  ove"  12S  papers  per 
month  called  quick  reaction  tasks.  Practically  all  products 
are  internally  generated  except  for  a  small  number  which  arc 
contracted  papers.  The  product  is  provided  at  no  cost  to  the 
user  except  for  a  time  delay  dependent  upon  the  complexity  of 
the  desired  information.  The  product  design  is  standardized 
and  no  radically  new  approaches  to  a  different  style  of  product 
arc  anticipated.  FTP  was  not  searching  for  a  new  product,  but 
a  better  method  of  preparing  and  servicing  an  existing  product. 
The  differences  between  product  types  docs  not  deter  grouping 
them  under  the  major  category  of  intelligence  documents.  The 
content  of  these  documents  and  their  method  of  transmittal  are 


the  products  and  services  capable  of  satisfying  the  FTD  con¬ 
sumers'  needs  and  wants. 

Scope  and  l.imi  tat  ions 

The  scope  of  this  study  covered  a  broad  field  of 
management  disciplines.  Basic  to  the  research  was  the  actual 
information  derived  from  the  survey  instrument.  The  questions 
on  the  survey  were  divided  into  several  sets.  The  identity  of 
respondents  was  catalogued  when  available,  and  membership  in 
larger  organizations  further  classified  each  respondent  into 
one  of  approximately  ten  groups.  lach  user's  requirements 
were  recorded  in  the  computer  data  file  and  included  variables 
such  as:  areas  of  interest,  methodology  desired,  time  require¬ 
ments,  usage  frequency,  and  applications.  Specific  information 
concerning  the  Intelligence  Production  Requirements  (IPR)  svstem 
was  also  tabulated.  'leans  of  communication  and  data  concerning 
further  analysis  efforts  were  also  collected.  Possibly  the  most 
beneficial  section  of  the  survey  was  Part  II,  which  outlined 
user  suggestions  and  comments  for  ways  to  better  satisfy  con¬ 
sumer  needs  associated  with  specific  products. 

The  most  pressing  limitation  to  this  study  was  the  time 
clement  necessary  to  tabulate  data  from  respondents  located 
around  the  world.  Initial  distribution  of  the  survey  was  in 
batches,  and  it  was  discovered  that  sometimes  not  all  of  the 
transmitted  questionnaires  were  actually  distributed  to  depart¬ 
ment  users  because  of  local  policies.  The  sample  data  file  is 
still  being  collected  for  further  study  by  FTP.  For  purposes 
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of  this  report,  the  cut  off  date  for  the  data  collection  was 
1  July  1979. 


Another  limitation  was  the  nature  of  classified  comments 
some  respondents  gave.  All  classified  information  or  references 
to  classified  sources  were  kept  out  of  the  data  base.  Where 
users  responded  with  two  answers  for  questions  which  required  a 
single  answer,  the  response  was  either  eliminated  or  identified 
as  missing  or  with  a  :cro.  No  preference  was  given  to  any  one 
respondent,  and  every  effort  was  made  to  eliminate  possible 
transmission  and  transformation  errors  from  the  survey  to  the 
data  file. 

App 1 i c ab i  1  i  t y 

Tiif'  results  of  this  market  research  effort  could  have 
far-reaching  effects.  Budget  and  resource  allocation  to  the 
Sf.T  community  might  be  affected  by  identifying  priorities  and 
special  requirements.  Management  effectiveness  for  the  intelli¬ 
gence  processing  system  might  be  improved.  Information  currently 
provided  in  products  that  consumers  say  is  not  needed  can  be 
eliminated.  Likewise,  processing  of  products  can  be  streamlined 
by  providing  the  consumer  only  what  he  needs.  The  organ i rat  ion- 
client  relationship  can  be  improved  by  more  accurately  matching 
consumer  requirements  with  product  outputs. 

This  research  attempted  to  analvre  the  market  structure 
of  a  government  service  agency.  While  similar  studies  have 
been  done  for  the  Department  of  Agriculture,  Interstate  Commerce 
Commission,  and  Department  of  Justice,  more  service  oriented 
government  agencies  need  to  examine  their  organizational 


strategies  by  assessing  consumer  preferences  about  existing 
goods  and  services.  In  th:s  way,  factors  that  improve  communi¬ 
cations,  save  resources,  and  provide  accurate  and  useful 
services  will  eventually  benefit  the  taxpayer  by  saving  him 
money . 

!>e  fin  i  t  i  ons 

Before  reviewing  the  role  of  marketing  in  some  govern¬ 
ment  agencies,  it  is  useful  to  present  definitions  central  to 
marketing  and  management  activities.  A  marketing  problem  con¬ 
sists  of  identifying  the  market,  with  its  characteristics, 
needs  and  purchase  patterns,  and  then  developing  products  and 
marketing  programs  to  meet  these  needs.  A  marketing  arena 
exists  in  almost  every  endeavor  conceived  by  man.  In  the 
government  arena,  however,  there  arc  a  few  special  cases.  Kith 
limited  time  and  resources,  the  market  for  government  goods  and 
services  is  too  vast  to  be  defined  precisely.  lor  the  Foreign 
Technology  Division,  the  market  is  exclusively  individuals  or 
agencies  with  the  appropriate  security  clearance  and  a  bona 
fide  need  to  know.  The  characteristics  and  needs  of  FTP  users 
would  be  similar  to  those  interested  in  Sf>T  information  in  non¬ 
government  concerns.  One  current  and  significant  difference 
that  distinguishes  users  of  FTP-produced  documents  and  publi¬ 
cations  is  the  price  paid  for  information.  The  direct  cost  to 
any  FTP  user  is  only  the  delay  time  from  the  request  being 
approved  until  receipt  of  the  document.  Thus,  the  marketing 
problem  for  FTP  was  to  clearly  identify  the  requirements  of  its 


consumers.  Improvement  of  intelligence  products  by  efficient 
production  became  a  key  management  objective. 

Marketing  is  defined  in  many  ways  by  various  researchers. 
The  positive  and  negative  connotations  given  to  marketing  reflect 
its  pervasive  nature  and  tendency  to  mean  different  things  to 
different  people.  One  noted  scholar  in  the  management  field, 
Peter  P  r uc  k e  r ,  states. 

Marketing  is  so  basic  that  it  cannot  be  considered  a 
separate  function.  ...  It  is  the  whole  business  seen 
from  the  point  of  view  of  its  final  result,  that  is,  from 
the  customer's  point  of  view  (10:31. 

Thus,  marketing  involves  practically  every  human  activity.  As 

its  main  criterion  of  effectiveness,  marketing  measures  the 

degree  of  consumer  satisfaction  with  goods  and  services.  As  a 

result,  marketing  may  be  defined  as  a  system  wherein  business 

activities  of  planning,  pricing,  promotion,  and  distribution 

act  to  satisfy  the  wants  (and  needs)  of  consumers.  The  Ma rket i ng 

Handbook  defines  marketing  as: 

-an  organized  system  of  business  activities  that  makes 
possible  the  flow  of  goods  and  services  from  production 
through  consumption  and  strives  to  match  production  and 
consumption  by  representing  producers  to  consumers  and  con¬ 
sumers  to  producers  [ll:p.l-2]. 

One  can  apply  these  definitions  of  marketing  to  FTP  by 
adding  one  more  term.  That  term  is  service.  FTP  provides  a 
service  along  with  the  provision  of  specific  documents  and  pub¬ 
lications.  Products  provided  as  a  result  of  quick  reaction 
tasks  most  nearly  fit  this  service  category.  The  service  is 
designed  to  improve  a  user's  performance  through  reduction  of 
uncertainty  in  a  specific  area  with  which  the  user  is  vitally 
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concerned . 


The  marketing  strategy  FTP  has  undertaken  is  to  clearly 
identify  their  clients'  needs,  provide  the  required  products 
and  services  to  the  consumers'  satisfaction,  and  continue  to 
match  the  consumers'  desires  to  efficient  products.  Information 
to  aid  this  strategy  can  he  found  in  this  study. 

By  collecting  the  above  definitions  and  applying  FTP  and 
its  environment  to  tins  collection,  one  can  state  that  marketing 
involving  FTP  takes  place  as  the  exchange  of  goods  and  services 
between  FTP  and  their  clients.  For  this  exchange  to  he  satis¬ 
factory  to  the  client,  I  TP  must  he  fulfilling  the  clients'  needs 

As s  umpt 1 o  n s 

In  outlining  the  assumptions  made  in  this  study,  the 
boundaries  of  the  marketing  system  and  environment  encompassing 
FTP  and  its  users  will  necessarily  he  limited.  These  limita¬ 
tions  arc  required  to  feasibly  manipulate  the  data:  all 
possible  dimensions  anil  characteristics  of  the  users  and  FTP 
cannot  realistically  he  measured.  Many  insights  have  been 
obtained.  These  views  point  to  further  areas  for  investigation 
as  well  as  immediate  tasks  which  can  he  undertaken  to  further 
satisfy  the  needs  of  FTP  users. 

Market  research  is  closely  tied  to  the  decisions,  goals 
and  objectives  of  the  dec i s ion  maker ,  as  well  as  to  the  specific 
profile  concerning  his  customers  and  products.  To  begin  the 
process  of  establishing  goals  and  objectives,  a  clear  statement 
of  the  problems  and  understanding  of  the  participants  involved 


is  necessary.  FTD  has  undertaken  the  quest  for  this  knowledge 
about  its  users  through  the  use  of  the  1979  Sf,T  intelligence 
user's  questionnaire.  The  response  to  this  survey  approached 
50  percent  of  the  total  population  of  users  of  FTD  products. 

Thus,  a  decision-maker  evaluating  this  study  needs  to  have 
ample  confidence  in  the  facts  presented  in  order  to  accurately 
plan  the  organization's  goals  and  objectives.  \  necessary 
assumption  that  aids  in  this  planning  is:  provided  a  repre¬ 
sentative  sample  of  organizations  is  available,  then  the  typical 
organizational  users  of  FTD  documents  and  publications  in  the 
near  future  v.  i  1  1  not  vary  significantly  from  the  available 
sample.  It  this  assumption  was  not  made,  it  would  be  useless 
to  attempt  to  predict  any  future  trends  or  strategy.  The  basic 
network  of  intelligence  organizations  appears  relatively  stable 
for  the  near  future  and  underlies  the  ability  to  make  this 
assumption  without  reservation. 

\nother  ncccssarv  assumption  is  that  the  population  of 
users  of  FTD  products  have  made  independent  judgments  about  the 
survey.  This  allows  the  researcher  to  weight  each  respondent 
equally  and  not  presume  the  data  has  been  biased  by  the  collu¬ 
sive  efforts  of  the  respondents.  bach  reply  is  taken  at  its 
face  value,  and  any  combinations  of  respondents  constitutes 
aggregations  of  individual  responses.  In  fact,  no  weightings 
have  been  used  in  the  analysis  so  that  management  can  determine 
the  relative  importance  of  the  recommendations. 

The  questionnaires  were  distributed  from  a  composite 
list  of  consumers  who  actually  ordered  and  received  FTD  documents 


and  publications.  Organizational  responses  were  desired  which 
could  identify  unique  requirements  of  the  users  of  S5T  intelli¬ 
gence.  The  third  assumption  necessary  deals  with  the  experi¬ 
ences,  beliefs,  attitudes,  and  sensations  of  the  individual 
users.  One  must  assume  that  the  responding  individuals  are 
cognizant  that  thev  are  identifying  requirements  and  needs  con¬ 
sistent  with  their  own  organizational  objectives.  In  this  case, 
the  implication  is  that  user  needs  match  the  needs  of  the  organi¬ 
zation.  The  past  requirements  of  individuals  in  the  organization 
will  usually  tend  to  predict  their  future  requirements.  Thus, 
stable  requirements  for  the  near  future  are  assumed  to  be  similar 
to  requirements  of  the  recent  past. 

The  following  point  is  not  an  assumption,  but  more  a 
method  of  strategic  logic.  In  the  analysis,  specialized  groups 
which  indicate  an  item  to  be  very  important  or  moderately 
important  represent  a  group  01  v»1:;ed  consumers  to  FTP.  These 
special  users  will  become  tnc  subject  of  management  strategy 
and,  consequently,  both  the  users  and  FTP  can  improve  communica¬ 
tions  and  services.  Ifforts  directed  toward  satisfying  the  needs 
of  interested  users  will  elicit  more  benefit  than  efforts  directed 
elsewhere.  This  is  basically  selective  or  specialized  marketing 
designed  to  maximize  service  to  a  specific  group  of  users. 

\  well-founded  assumption  which  is  made  in  marketing  is 
that  the  total  error  of  a  test  market  will  decrease  as  a  function 
of  time.  This  is  a  reasonable  assumption  from  serveral  points 
of  view  and  is  a  more  general  statement  which  combines  some  of 
the  previous  assumptions.  More  information  is  collected  as  time 


10 


passes.  FTP  is  continuing  to  encourage  responses  to  the  S$T 
survey.  1 rror  of  prediction  based  on  these  responses  must  he 
at  least  non- i nc reas i ng  and,  more  likely,  are  decreasing  with 
respect  to  time.  Reopening  old  or  closed  channels  of  communi¬ 
cation  between  consumers  and  FTP  has  already  decreased  the 
possibility  of  FTP  wrongly  believing  a  user's  needs  have  or 
have  not  changed.  This  assumption  has  also  been  verified  from 
an  empirical  point  of  view  by  \.  C.  Neilson  Company  (lb).  The 
Seilson  Company  studied  100  test  market  cases  to  determine  the 
odds  of  predicting  a  test's  final  market  share  (within  201) 
given  that  the  test  was  observed  for  various  durations  of  time. 
The  study  showed  that  the  odds  after  two,  six  and  ten  months 
of  observation  were  1  out  of  7,  1  out  of  2,  and  S  out  of  b, 
respectively.  These  findings  explicitly  identify  that  estima¬ 
tion  error  decreases  with  increased  durations  of  market  obser¬ 
vations.  Thus,  for  FTP  to  continue  collecting  data  upon  which 
their  marketing  strategies  are  based  can  only  help  to  decrease 
the  possibility  of  error. 

Organ i sat  ion  of  the  Study 

This  research  is  composed  of  five  chapters  with  tables 
and  forms  included  in  the  appendices  plus  a  bibliography. 
Chapter  1  covers  the  nature  of  the  problem  and  subject  of  the 
research.  Chapter  I  also  outlines  the  scope  of  the  paper  and 
identifies  limitations  and  definitions  as  well  as  the  assump¬ 
tions  used  in  this  report.  Chapter  II  presents  a  literature 
review  of  similar  study  efforts.  Chapter  III  is  a  discussion 
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of  the  methodology  relevant  to  this  study.  Also  included  in 
Chapter  111  is  a  discussion  of  the  sample  population,  the 
survey  instrument,  and  their  validity.  The  analysis  techniques 
that  will  be  used  are  presented  in  Chapter  Ill.  Chapter  IV  is 
a  discussion  of  the  research  findings  and  their  relation  to  the 
work  system.  Chapter  V  contains  the  related  recommendations 
and  conclusions  alonj;  with  a  discussion  of  possible  future 
longitudinal  efforts. 


II.  1.  it  era  t  ure  Review 


Rclat ed  Market  Research  1  jui mp les 

The  field  of  marketing  is  relatively  young  when  com¬ 
pared  to  other  business  disciplines.  The  present  concept  of 
marketing  is  less  than  50  years  old.  However,  the  government 
has  actually  been  involved  with  marketing  from  the  time  of  the 
first  Continental  Congress.  The  name  marketing  may  not  have 
been  used,  but  there  was  a  definite  relationship  between 
citizens'  desires  and  government  services.  Related  market 
research  studies  in  government  arc  all  too  few;  the  reasons 
why  more  studies  have  not  been  done  in  this  rich  domain  are 
not  totally  clear.  Resides  the  youth  of  marketing,  a  likely 
cause  is  the  mystifying  aura  attached  to  applied  sciences  in 
general,  and  market  phenomena  more  specifically.  The  go\crn- 
ment  has  compiled  and  distributed  data  about  population, 
industry,  and  agriculture  for  many  years  that  is  heavily  used 
by  market  researchers.  However,  only  a  limited  number  of 
government  agencies  have  implemented  formal  marketing  programs 
or  established  marketing  departments. 

before  identifying  these  arenas  of  government  marketing 
the  need  for  marketing  programs  in  government  will  be  addressed 
Claxton,  ej^  al.  (4),  studied  ten  governmental  organizations  at 
the  federal,  provincial,  and  municipal  levels.  These  organiza¬ 
tions  involved  tourism,  agriculture,  social  grants,  and 
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libraries.  The  management  levels  within  the  programs  were  of 
various  types,  including  general  managers,  managers  of  specific 
areas  (such  as  advertising  managers),  and  branch  managers.  The 
study  took  place  over  a  two-year  period.  They  discovered  that 
seldom  were  consumer  interests  evaluated  in  a  formal  way,  and 
in  only  one  case  was  a  method  of  market  segmentation  used. 
Secondly,  they  found  that  government  program  managers  lacked 
the  expertise  to  study  user  interests  and,  thus,  were  unable 
to  communicate  effectively.  Government  managers  felt  a  need 
to  be  all  things  to  all  people.  The  last  finding  identified 
program  evaluation  as  an  area  requiring  continued  attention. 

The  study  called  for  a  broader  view  of  marketing,  not  only  in 
government,  but  also  in  other  non- t radit ional  areas.  The  impli¬ 
cation  of  the  report  is  improved  management  of  resources  through 
formal  investigation,  improved  communication  and  continued  re- 
evaluation  of  programs  to  better  satisfy  consumer  (citizens') 
needs . 

A  detailed  survey  was  administered  in  1951  to  a  random 
selection  of  Vrmy  officers  stationed  in  Furope  (5).  This 
investigation  was  similar  to  the  FTP  Sf-T  questionnaire  in  length 
(number  of  variables  observed),  and  the  results  were  used  to 
identify  manpower  needs  and  requirements.  The  mailed  question¬ 
naire  was  twenty- three  pages  long  and  contained  116  separate 
items  for  response  on  moral  problems,  career  interest,  and 
opinions  on  military  efficiency  methods.  To  convince  officers 
of  their  anonymity,  a  separate  post  card  was  included  in  the 
survey  package  with  instructions  to  mail  the  survey  and  postcard 
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separately  and  that  no  identification  was  required  on  the 
survey.  This  enabled  the  researchers  to  elicit  only  the 
officers'  opinions  from  the  survey  and  obtain  certification 
that  the  officers  had  returned  a  survey.  The  survey  response 
rate  was  891,  and  the  authors  concluded  that  within  the  Army 
officer  population  a  consistently  high  rate  of  return  could 
be  expected.  This  finding  originally  raised  the  expectations 
of  this  author  due  to  the  complexity  of  the  FTP  questionnaire. 

On  91  short -answer  questions  in  the  Army  survey,  the  range  of 
"no  answers"  was  from  :ero  to  f«ur  percent.  One  answer  had  a 
maximum  number  of  "no  answers"  of  33  percent. 

\n  agency  that  has  used  marketing  techniques  relatively 
early  in  the  government  arena  is  the  General  Services  Agency 
(GSA)  (IS).  Since  1949,  GSA  has  been  charged  with  disposing 
of  items  no  longer  used  by  the  world’s  largest  buyer  -  the 
Federal  government.  Marketing  influences  of  merchandising, 
publicity,  and  researching  potential  markets  have  enabled  GSA 
to  increase  the  return  on  investment  from  4 . 7  percent  in  1959 
to  6.7  percent  in  1962  (1S:29).  Market  conditions  are  re¬ 
searched  by  GSA  analysts  before  items  arc  placed  on  sale.  The 
sale  of  some  items  may  be  postponed  until  indications  point  to 
no  disruption  of  normal  commercial  marketing  activities.  Con¬ 
solidated  sales  sites  and  selective  direct  mailings  add  to  the 
advertising  ability  of  GSA.  Sales  of  real  property  now  include 
suggested  uses  and  photographs.  The  loss  is  still  costly 
since  only  a  fraction  of  the  original  property  value  is  realized. 
However,  marketing  is  conserving  resources  and  saving  taxpayers' 
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money  in  GSA. 

The  Federal  Trade  Commission  (FTC)  is  another  govern- 
merit  organization  involved  with  marketing  decisions.  The  FTC 
was  originally  established  in  1914.  In  1938,  the  Wheeler  Tea 
Amendment  to  the  Act  changed  the  view  of  the  Commission  from 
protection  among  and  between  businesses  to  protection  of  con¬ 
sumers.  In  1962,  the  Trade  Regulation  Rules  identified  the 
requirements  of  statutes  which  the  FTC  administers.  The  FTC 
strives  to  assure  and  maintain  a  "fair  and  competitive  environ¬ 
ment"  for  consumers.  Many  authors  have  beseeched  the  FTC  to 
heed  the  insights  from  market  researchers  to  better  serve  the 
consumer.  Suggestions  that  the  FTC  take  note  of  the  behavioral 
characteristics  of  the  consumer  and  amend  its  regulatory  frame¬ 
work  accordingly  have  been  nadc.  Cohen  pointedly  notes  that 
in  ".  .  .  broad  policy  terms  the  Commission  can  initially  do 
little  more  than  establish  closer  contact  with  the  consumer 
[5:43]."  She  believes  there  has  been  an  underutilization  of 
the  skills  and  insights  of  researchers  in  marketing  and  consumer 
behavior.  Wilkie  and  Gardner  have  pointed  out  how  marketing 
research  can  aid  the  public  policymaker  (17).  They  state  that 
there  is  a  substantial  gap  between  information  needs  and  the 
available  research  inputs.  They  suggest  the  research  needs  of 
the  FTC  can  be  defined,  but  these  policymakers  have  yet  to 
bridge  the  gap  with  consumer  researchers  and  market  analysts 
to  aid  in  solving  their  problems.  Identification  of  consumer 
needs  by  the  FTC  would  be  a  first  step  to  insure  maximum 
utilization  of  tax  dollars.  Thus,  marketing  concepts  and 


research  technology  still  have  a  fruitful  area  to  make  con¬ 
tributions  in  government  policies. 

The  Justice  Department  has  dealt  with  market  research 
on  numerous  occasions.  The  indictment  of  United  States  Steel 
and  Bethlehem  Steel  for  violating  the  provisions  of  the  anti¬ 
trust  laws  governing  price  fixing  is  just  one  example  (11. 
Whenever  the  behavior  of  market  participants  indicates  collu¬ 
sive  activity  designeu  to  influence  prices  and  production 
policies,  antitrust  charges  can  arise.  The  resolution  of  the 
case,  begun  in  1962,  *as  dependent  on  market  research  investi¬ 
gating  the  participants  and  their  collective  actions.  The 
courts  influence  the  market  structure  and  act  from  evidence 
supplied  by  market  studies  to  substantiate  their  decisions. 

Many  times  court  rulings  have  further  influenced  market  behavior 
and  market  research  by  upholding  the  BTC's  statutes.  Whether 
or  not  one  agrees  uith  the  substantive  claims  made  by  the  FTC, 
the  judicial  construction  governs.  In  a  case  involving  BTC 
versus  Colgate-Palmolive  Co.  (85  S.ct  1035,  1965),  the  court 
supported  the  BTC's  finding  that  the  advertiser  and  its  adver¬ 
tising  agency  had  deceived  potential  purchasers.  Thus,  all 
advertisers  must  now  accept  responsibility  for  the  content  of 
commercials  prepared  for  them  bv  advertising  agencies. 

The  National  Science  foundation  sponsored  a  market  study 
in  1974  that  undertook  the  task  of  answering  the  question  of  how 
federa 1 lv- developed  technology  could  be  transferred  to  the 
commercial  sector  (14).  A  project  called  the  NASA  Automated 
Attendance  Management  System  (AAMS)  was  developed  at  the  Jet 


Propulsion  Laboratory  to  combat  problems  associated  with  poor 
attendance  in  schools.  The  market  research  involved  a  pilot 
test  at  one  high  school  and  eventually  targeted  (segmented) 
lbb  schools  in  California  to  be  approached  with  this  new  pro¬ 
duct.  Some  obstacles  encountered  were  the  high  cost  of  the 
system  ($132,000  with  110  classroom  input  units)  and  initial 
capital  financing  for  such  a  high-cost,  limited  market  system. 
These  problems  were  being  solved,  but  the  patent  obtained  from 
the  government  took  1-1/2  years  to  obtain  and  is  not  exclusive 
to  the  investing  company.  These  researchers  also  reported 
four  methods  for  speeding  technology  transfer  from  the  govern¬ 
ment  to  the  commercial  sector.  While  these  findings  were 
probably  slanted  toward  private  industry,  they  point  out 
government  interest  in  sponsoring  market  research  to  transfer 
technology  to  the  private  sector. 

In  1925,  the  Defense  Documentation  ('enter  (DDC)  initi¬ 
ated  a  ten-year  requirements  and  planning  study  (12).  Auerbach 
Associates,  under  contract  from  DDC,  interviewed  fourteen  other 
agencies  in  the  field  of  providing  technological  and  scientific 
information  to  develop  objectives  in  the  1978-1988  timeframe. 

The  results  of  interviews  pointed  out  three  overall  perceptions: 

A.  DDC's  primary  mission  was  to  serve  the  DOD  RDT&E 
commun i ty . 

B.  Interagency  environment  role  is  very  important. 

C.  Advancing  the  state  of  art  in  information  processing 
is  a  necessary  objective  (12). 


They  discovered  the  marketing  of  DDC  products  and  services  is  a 
two-way  process:  it  involves  education  as  well  as  obtaining 
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user  feedback.  Results  indicated  DPC's  sole  reliance  on  POP 
technical  reports  for  its  Sf,T  information  base  is  at  variance 
with  the  policies  of  the  Sf>T  information  community  at  large. 

The  study  pointed  out  a  need  to  broaden  their  range  of  services 
and  involve  the  user  in  a  feedback  process  to  maintain  good 
serv  ices . 

The  National  Science  foundation  (NSF)  and  the  User 
Requirements  Program  of  the  Office  of  Science  Information  Ser¬ 
vices  sponsored  an  experiment  in  lP^b  to  identify  markets  and 
suggest  approaches  to  meet  needs  in  the  Sf,T  information  field 
( 8 ) .  This  study  surveyed  Z'4  individuals  in  177  firms  in 
Pennsylvania.  The  firms  were  stratified  by  sire  and  distri¬ 
buted  across  11  SIC  codes  the  NSF  had  identified  as  RfiP  inten¬ 
sive.  Results  supported  the  hypothesis  that  there  arc  a  variety 
of  segments  of  the  Sf,T  information  market.  The  existence  of 
various  market  segments  suggested  the  need  for  tailored  market¬ 
ing  programs  for  each  of  the  segments.  The  first  conclusion 
dealt  with  the  concept  of  tin.  buying  center  for  Sf(T  information 
needs  and  identified  the  RftP  manager  as  the  primary  member. 
Secondly,  the  researchers  concluded  no  single  product  (or  ser¬ 
vice!  will  meet  all  the  needs  of  firms  using  Sf,T  information. 

The  final  conclusion  was  that  while  some  product  attributes 
arc  important  to  no  S5T  information  users,  there  are  no  charac¬ 
teristics  that  arc  important  to  the  whole  market. 

A  final  related  study  was  sponsored  by  a  National 
Science  Foundation  grant  to  provide  data  in  targeting  product 
design,  distribution,  and  promotion  efforts  effectively  (2). 
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The  study  was  conducted  by  Forecasting  International,  Ltd.  to 
develop  a  methodology  for  improving  the  knowledge  about  S^T 
information  user  characteristics  in  general  rather  than  the 
provision  of  hard  operational  data  for  use  in  specific  market¬ 
ing  programs.  Nine  types  of  information  needs  of  S$T  users 
were  ranked.  The  users  were  402  chemists  and  engineers.  This 
project  determined  that  it  would  have  bei.i  financially  infeas¬ 
ible  to  conduct  the  survey  by  personal  interviews,  and  that  a 
sufficient  sample  could  be  obtained  from  a  se 1 f - adm i n  i  s tcred 
questionnaire.  \n  indication  of  the  requirement  for  greater 
choice  in  format  was  found  to  be  necessary  in  the  future. 

Results  of  the  analysis  provided  a  description  of  six  segments 
in  both  the  chemist's  and  engineer's  subsets.  This  finding 
led  the  researchers  to  conclude  their  methodology  was  applicable 
to  market  segmentation  techniques  and  should  be  employed  to 
survey  the  remainder  of  the  S&T  information  user  universe. 

In  summary,  only  preliminary  use  of  marketing  tech¬ 
niques  in  government  or  the  field  of  information  processing 
has  been  accomplished.  What  work  has  been  done  has  saved 
valuable  resources  and  given  new  insight  to  government  agencies 
as  to  future  goal  and  market  strategics. 
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III.  Methodology 


l  he  1  TP  Sf, J  I  nte  1 1  igcnc e  Use r  '  s 
Oue s t i onna i re 

The  FTP  S{iT  intelligence  survey  was  conducted  from 
1  April  to  1  July  of  1 9 .  The  text  of  t he  survey,  along  with 
instructions  and  the  attached  cover  letters,  can  he  found  in 
Appendix  A.  To  impart  the  most  realistic  feeling  to  the  sur- 
vcy  results,  a  composite  publications  and  documents  mailing 
list  wa*.  derived;  all  individuals  and  organizations  on  this 
list  were  selected  for  distribution  of  the  survey.  These 
consumers  represented  over  95  percent  of  the  universe  of  past 
l TO  users. 

Two  methods  of  distribution  were  used.  Slightly  more 
than  one -half  of  the  survevs  were  distributed  by  a  single 
mailing,  and  the  remainder  were  distributed  in  person  to  organi¬ 
zations  as  an  aid  in  expediting  their  return.  V  total  of  644 
usable  survevs  were  returned.  Responses  were  coded  and  punched 
on  computer  cards  that  were  transferred  to  disc  file  storage 
in  the  ASP  CYR1  R  1~5  computer  systems  in  retrieval  and  histori¬ 
cal  reference.  Table  5.1  indicates  the  response  return  percen¬ 
tages  broken  down  between  mailed  and  drop-off,  as  well  as 
overall  responses.  The  represented  organizations  are  a  subset 
of  the  individual  questionnaires  distributed. 

Though  the  overall  response  rate  is  only  about  21  percent, 
the  organizational  response  rate  of  nearly  50  percent  is  a  more 
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TABU  3.1 


Response  Return  Rates  for  Mailed,  Prop-Off 


anJ  Overall  Methods  of  Distribution 


Sent 

Returned 

1  Returned 

MAI  U  P 

I nd i v i dua 1 s 

1760 

311 

17.6 

Rep resente d  Or g a n i : a t i o n s 

482 

_  _J 

r  i 

45.6 

PROP -OFT 

I nd l v i dua  1  s 

1313 

3  33 

25.4 

Represented  Organ l :a t ions 

34 

25 

73.5 

O.R  \  NP  TOT  \l. 

I nd l v l dua 1 s 

30  R  2 

644 

20.9 

Represented  Organ i :at ions 

516 

245 

_ _ 

47.  S 

realistic  representation  of  our  sample  to  the  user  population. 
The  basic  weakness  of  this  survey,  as  with  most  mailed  surveys, 
is  the  loss  of  control  the  interviewer  has  over  the  question¬ 
naires  after  distribution.  Time  constraints  did  not  allow  for 
personal  interviews.  Yet,  the  dual  method  of  distribution  did 
allow  for  significant  coverage  and  a  representative  sample  of 
the  universe  of  1  TP  users.  \  listing  of  the  responding  organi¬ 
zations  can  be  found  in  Appendix  B. 

The  questionnaire  consisted  of  three  pages  printed  front 
and  back  plus  one  additional  page  of  comments.  The  survey  was 
quite  detailed  and  required  approximately  4  5  minutes  to  complete 
The  survey  consisted  of  27  questions  and  was  divided  into  two 
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parts;  the  first  part  requested  information  about  individual 
requirements,  the  second  part  requested  an  evaluation  of  speci¬ 
fic  documents.  To  allow  the  respondent  as  much  freedom  of 
choice  as  possible,  no  instructions  mandated  completion  of  any 
part  of  the  survey. 

\  test  response  was  collected  from  eleven  users  prior 
to  initial  distribution.  The  test  was  conducted  to  validate 
the  questions  for  clarity  and  understanding.  Information 
gained  in  this  test  identified  no  problem  areas  requiring 
changes,  but  one  respondent  did  indicate  possible  future  prob¬ 
lems  with  Question  1  by  not  identifying  himself.  This  test 
was  conducted  in  a  classroom  atmosphere  on  8  March  1979. 

The  first  question  identified  the  user  organization  and 
the  respondent.  The  second  question  allowed  the  respondents 
to  categorize  thersclves,  ne.irh  as  possible,  by  the  primary 
mission  of  their  office.  Questions  3  through  7  elicited  both 
current  and  future  importance  evaluations  from  respondents  in 
the  topics  of  functional  areas  of  aerospace  Sf,T  intelligence, 
winds  of  intelligence,  degrees  of  analysis,  reporting  format, 
and  dissemination  means,  respectively.  Question  8  allowed  for 
comments  about  reporting  format  and  dissemination  means. 
Questions  9  through  21  and  23  through  25  solicited  opinions 
and  data  on  a  variety  of  topics  including: 

(1)  Timeframe  of  Need 

(2)  location  of  Source 

(3)  Reaction  Time  of  User 

(4)  User's  Frequency  of  Use 
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(S)  Importance  of  Methodology  to  User 
(o)  User's  Knowledge  of  Intelligence  Production 
Requirements  System  (IPRS) 

(?)  Use  of  Additional  Analysis  hv  Consumers 

(8)  Method,  Purpose,  and  Importance  of  Communication 
to  ITU  Within  the  Past  Year 

(9)  Contact  Necessary  Between  User  and  ITU  Analysts 

(10)  Actual  Use  of  ITU  Produced  Documents 

Question  22  requested  the  respondent  indicate  the  importance  of 
eleven  applications  of  Sf,I  intelligence  to  his  current  work. 
Question  2"  requested  the  user  evaluate  two  ITU  products.  It 
was  determined  in  the  pre-test  that  no  single  product  was  appli¬ 
cable  to  all  users,  thus  the  respondents  were  requested  to 
identify  the  product  thev  evaluated  by  use  of  the  Document  Short 
Title  (DST)  number.  Manv  respondents  did  not  evaluate  specific 
products  but  merely  stated  "general"  or  "overall"  for  the  DST 
number.  The  indicated  ITU  products  were  evaluated  with  questions 
concerning  the  following  areas: 

(1)  Currency  of  Data 

(2)  Production  frequency 

(3)  Subjects  Covered 

(4)  Changes  in  Kmphasis  Required 

(5)  Changes  in  Textual  Content  Required 

(b)  Changes  in  Textual  Supplements  Required 
(7)  Comments 

A  selected  listing  of  questions  for  the  M4  respondents,  by 
percentage,  can  be  found  in  Appendix  B.  Chapter  IV  contains 


the  results  and  discussion  of  the  product  evaluations. 


Non  -  Respondent s 

The  S&T  intelligence  user's  questionnaire  was  directed 
toward  a  small,  defined  population.  As  such,  the  accuracy  of 
the  survey  rests  on  the  precision  with  which  the  sample  repre¬ 
sents  the  population.  \  considerable  body  of  literature  exists 
that  indicates  non  respondents  may  differ  markedly  from  respon¬ 
dents  in  anv  survey  sample.  The  problem  any  researcher  has 
with  non  respondents  is  determining  the  representativeness  of 
a  sample  population.  1 ven  the  most  careful  investigator  is 
obliged  to  describe  or  explain  the  non- respondents  and  how  they 
might  prejudice  the  sample. 

The  Survcv  Research  ('enter  at  the  University  of  Michigan 
conducted  a  studv  of  non  respondents  to  mail  surveys  and  their 
implications  for  interpretation  of  questionnaire  data  (7). 

The  purpose  of  their  study  was  to  investigate  the  internal 
functioning  and  effectiveness  of  local  units  of  the  League  of 
Komen  Voters.  They  found  that  52.1  percent  of  non  -  respondent s 
were  zero  or  marginal  participants  in  the  organization.  These 
minimally  involved  individuals  did  not  support  the  organization 
in  any  active  sense.  The  correlation  of  this  attitude  with  the 
non- respondent  to  the  ITi)  survey  is  quite  possible.  Reasons 
for  non  response  would  be  purely  speculative,  and  many  hypotheses 
could  be  identified  that  appear  reasonable. 

Validity 

The  validity  of  a  measuring  instrument  can  be  resolved 
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intended  purpose  (13: 


by  asking  whether  or  not  it  achieved  its 
8t>)  .  There  are  manv  ways  validity  can  he  interpreted.  The 
basic  opinions  of  people  regarding  the  feasibility  of  various 
aspects  in  developing  and  employing  a  questionnaire  are  prac¬ 
tical  inputs.  IT!)  developed  the  structure  of  the  instrument 
through  numerous  personal  interviews  with  users  and  consulta¬ 
tion  with  \l  IT  researchers.  The  FTP  survey  establishes  an 
initial  baseline  for  future  comparisons. 

The  way  in  which  the  instrument  has  been  used  gives  the 
greatest  meaning  to  its  accuracy  and  validity.  The  type  of 
validity  most  applicable  to  the  FTP  questionnaire  is  content 
validity.  Content  validity  is  not  predictive  in  nature.  It 
depends  on  the  adequacy  with  which  a  specified  domain  of  content 
1 s  samp  led  (13:87). 

The  SfiT  user  requirements  arc  the  domain  of  interest  for 
FTP.  The  sample  responses  from  organizations,  collected  by  the 
researcher,  constitute  a  significant  portion  of  the  FTP  user 
population.  Since  the  consolidated  documents  and  publications 
mailing  list  represented  at  least  9St  of  all  users  and  the 
return  from  these  users  was  J8T,  our  sample  represents  4bt 
(.95  x  .48)  of  the  total  population.  This  is  a  more  representa¬ 
tive  group  than  all  voters  in  a  national  election.  Given  the 
existence  of  a  very  adequate  sample,  the  accuracy  in  identifying 
requirements  will  now  bo  addressed. 

Accuracy  may  be  defined  as  the  degree  of  correlation 
between  respondents'  statements  and  behavior.  Accuracy  also 
involves  the  degree  of  consistency  between  intended  and  actual 


behavior.  The  FTP  surveys  were  analyzed  to  determine  if  any 
inconsistent  answers  or  respondents  existed.  Three  surveys 
were  omitted  from  the  file  because  these  individuals  identi¬ 
fied  themselves  as  having  never  used  FTP  intelligence  informa¬ 
tion.  There  were  two  individuals  who  erred  by  answering  a 
question  indicating  they  would  not  answer  the  next  few  questions 
and  yet  provided  answers  to  those  questions.  So  single  question 
pointed  to  any  significant  problems  in  comprehension.  One  indi¬ 
cation  of  this  is  the  number  of  missing  responses  to  survey 
quest  ions . 

Item  non- response  arises  when  a  person  returns  a 
questionnaire  v»  i  t  h  some  questions  unanswered.  Craig  and  McCann 
( c> )  found  that  the  extent  of  item  non- response  appeared  to  be 
independent  of  questionnaire  length  and  to  vary  systematically 
with  age  and  education.  They  also  found  that  activity  interest- 
opinion  questions  were  less  likely  to  be  unanswered.  The 
general  number  of  item  non-response  on  a  survey  range  from  31 
to  84.  The  FTP  survey  bad  a  3.141  item  non  response  for 
questions  dealing  with  single  issues.  lor  questions  dealing 
with  more  than  one  issue  (functional  areas,  kinds  of  intelli¬ 
gence,  format,  dissemination,  and  applications),  the  item  non¬ 
response  was  10.44 .  The  overall  item  non-response  was  8.344. 
These  findings  are  consistent  with  the  Craig  and  McCann  research 

\nother  indication  of  the  consistency  of  the  data  was 
obtained  by  comparing  the  opinions  of  early  respondents  with 
late  respondents.  The  difference  between  the  first  100  res¬ 
pondents  and  the  last  100  respondents  did  not  vary  more  than 


10'..  1  he  major  Jitlrmuf  between  these  two  groups  was  that 

tin  Majority  {411)  ot  the  first  100  were  involved  in  KM),  while 
only  a  minority  (91)  ot  the  last  100  indicated  RM>  as  their 
primal)  mission.  This  is  a  reasonable  difference  due  to  the 
proximitv  ot  a  large  KM'  complex  to  ITD,  which  decreased 
i  a  i  1  i  tig  t  mil's  . 

\  further  indication  of  the  measurability  of  the  sample 
is  tin-  decree  ot  respondents'  involvement.  To  attempt  to  meas- 
ure  tins  i nvo 1 ver ent ,  one  needs  to  believe  that  an  individual 
who  has  spent  over  50  minutes  replying  to  a  survey  and  then 
rakes  a  personal  effort  in  the  torn-  of  comments  is  involved  with 
the  subject  material.  Over  4 1  %  of  the  respondents  took  the  time 
to  evaluate  spei  i  tic  products,  and  approximately  2 1 l  of  the 
respondents  cade  additional  currents.  lie  immediate  result 
of  tlese  currents  *as  to  either  add  to  or  clarify  information 
foi  the  respondent  or  to  discuss  suggested  areas  fot  improve¬ 
ment.  both  types  of  comments  opened  and  increased  the  commu¬ 
nication  channels  between  the  users  and  ITP. 

Reliability 

- -  .  .  _  -  A 

Reliability  of  the  S.f,T  user's  survey  can  be  evaluated 
bv  repeating  the  survey.  lime  is  not  available  for  duplication 
ot  efforts  which  would  identify  random  influences  that  tend  to 
make  measurements  different.  \  close  approximation  has  already 
been  explained  in  the  nature  ol  small  differences  between  early 
and  late  respondents.  The  survey  is  also  internally  consistent 
with  respect  to  respondents  sel f * ident i f icat ion .  Verification 
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of  this  was  accomplished  by  taking  identified  subsets  from  the 
questionnaire  and  correlating  or  comparing  their  responses  with 
questions  that  turthcr  identify  their  subset.  The  policy- 
planners  and  decision-makers  usually  prepared  briefings  lor 
policy  makers  and  planners.  The  Rt,P  subset  was  involved  with 
applications  ot  UPTf,|  of  II. S.  equipment.  I  he  military  opera 
t  ions  subset,  to  a  large  degree,  prepared  briefings  for  air 
crews  and  responded  that  conducting  military  operations  was 
very  important.  The  intelligence  group  believed  targeting  for 
intelligence  collection,  developing  intelligence  threats,  and 
integrating  information  into  intelligence  studies  important. 
These  comparisons  not  only  signify  the  inteinal  consistency  of 
the  sample  with  respect  to  sell  ident living  responses,  hut 
actuair.  verify  that  the  respondents  have  given  considerable 
thought  to  answering  the  survey. 

One  further  point  needs  to  be  made  relative  to  the 
applicability  of  the  sample  to  the  entire  S(,T  user  community. 
Only  2.  S'  (In  individuals)  that  returned  the  survey  indicated 
that  the\  never  used  aerospace  Sf,I  intelligence  (Question  13). 
lhis  fact  alone  indicates  the  survey  was  addressed  to  actual 
u-ers.  In  further  describing  the  survey  sample,  671  of  the 
respondents  indicated  that  they  actually  use  and  extract  data 
from  I  TP  produced  documents. 

\naW  s  is 

Various  techniques  of  statistical  analysis  were  used  in 
this  study.  Chapter  IV  outlines  the  findings  and  implications 
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of  these  tests.  Current  and  future  responses  of  importance 
were  evaluated  tisinc  the  Student's  t-test  to  identify  differ 
ences  between  mean  responses.  Discriminant  analysis  was  used 
to  distinguish  one  subgroup  from  another  as  an  aid  in  identi¬ 
fication  of  user  profiles.  The  subsets  within  the  sample 
were  also  arrayed  with  the  use  of  cross - tabulat  ion  techniques 
to  identify  needs  of  particular  subsets.  This  allowed  the 
researcher  to  selectively  identify  valued  customers.  Chapter 
\  begins  with  a  summary  of  significant  findings  and  their 
implications  to  the  management  strategists  and  decision-makers 
at  HU. 
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IV.  Findings  and  Results 

Current  Versus  Future  Importance 

The  first  task  in  the  analysis  of  the  FTD  user's  survey 
was  to  determine  if  any  change  existed  between  evaluation  of 
current  and  future  importance  made  by  the  respondents.  The 
results  ot  such  findings  might  allow  the  FTD  management  planners 
to  subjectively  evaluate  program  emphasis  based  on  the  users' 
opinions.  If  a  user  indicates  a  decrease  in  importance  from 
the  current  time  to  the  future  for  a  specific  variable,  then 
FTD  managers  can  interpret  this  result  as  indicating  less 
effort  and  resources  should  be  committed  in  that  arena.  When 
the  sample  indicates  an  increase  in  importance  for  a  future 
topic,  management  should  consider  committing  more  effort  and 
resources  to  that  topic  to  better  fulfill  the  users'  needs. 

One  must  remember  that  the  evaluation  of  differences  between 
current  and  future  importance  is  valid  only  for  a  specific 
topic;  and  when  differences  are  identified  between  topics, 
great  caution  must  be  observed  in  interpretation.  Users  were 
not  specifically  asked  to  rank  the  variables,  and  for  the 
researcher  to  do  so  would  he  reading  between  the  lines  of  the 
respondents’  intended  meaning. 

Four  major  areas  on  the  survey  presented  questions 
requesting  evaluation  of  current  and  future  importance.  These 
topics  are  the  functional  areas  of  aerospace  S&T  intelligence. 
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kinds  of  intelligence,  reporting  format  and  dissemination 
means.  A  complete  listing  of  these  major  areas  comparing 
current  and  future  sample  mean  importance  (X)  can  he  found 
in  Appendix  l! .  these  comparisons  were  made  using  the  entire 
sample  (fable  l.l),  decision  makers  (Table  C.2),  research 
and  development  respondents  (Table  (.3),  military  operations 
respondents  (Table  (  .4),  and  intelligence  respondents  (Table  C'.S) 

I  uric  t  lona  1  \reas 

lor  the  total  sample  there  were  11  functional  areas 
dittcnng  in  importance  between  short  terra  and  the  future. 

Only  two  ot  these  areas  increased  in  importance  in  the  luture. 
They  were  Ant  i  -  sa  t  el  1  i  te  systems  and  1'irected  l.nergy  technology 
and  systems.  fhe  remaining  areas  either  decreased  in  import¬ 
ance  or  were  equally  important  between  current  and  future 
(see  Table  C .  1  1  )  . 

The  decision-makers  indicated  only  three  functional 
areas  as  s i gn i f i c ant  1  \  different  in  importance  between  current 
and  future  time  trams.  Ihesc  areas  were: 

Bomber  Virciaft  Systems  and  Subsystems 

\pplied  \erospace  Technologies 

Directed  I nergv  lechnologics  and  Systems  (Table  C.2-1) 

The  implications  of  these  differences  include  the  current 
SALT  II  treaty  discussions. 

Military  operators  and  intelligence  respondents  indi¬ 
cated  a  decrease  in  importance  in  all  areas  that  were  evaluated 
as  significantly  different  (see  Table  C.4-1  and  C.S-1).  These 


two  groups  did  not  identify  ant i -  sate  1 1 i te  systems  or  directed 
energy  systems  as  different  in  the  future.  This  view  appears 
valid  because  they  do  not  currently  operate  in  these  areas. 
Another  difference  from  the  overall  sample  was  IK  and 
threat  simulator  validation.  1  he  military  operators  and 
intelligence  respondents  indicated  a  decrease  in  importance 
in  this  area  tor  the  future.  1  he  military  operators'  opinion 
ot  applied  aerospace  technologies  decreased  in  importance  in 
the  long  term.  The  intelligence  respondents'  opinion  of  pre¬ 
liminary  aircraft  design  decreased  in  importance  in  the  tuture 
Particular  attention  should  he  given  these  two  areas  because 
the  causes  behind  the  decrease  are  not  clear. 

Ihe  research  and  development  respondents  indicated  13 
functional  areas  as  different  in  the  future,  and  all  i nc r ea scd 
in  importance.  Compared  with  the  total  sample,  the  Rt,P  types 
believed  the  following  areas  increased  in  importance: 

Ballistic  Missile  facilities  and  iquipment 
Space  Systems  and  Subsystems 
f  1 cc  t  ro  Op  t i c  a  1  Systems 
Preliminary  Aircraft  Design 
Preliminary  Aerodynamic  Missile  Design 
Aerospace  Technologies  Research 

IK  and  C ^  Threat  Simulator  Aalidation  (Table  C.3-1) 

The  overall  increase  in  importance  identified  by  the  Rf>D  res¬ 
pondents  points  to  these  individuals  a  primary  users  of  FTP 
produc  t  s . 


One  last  item  remains  to  be  addressed  concerning 


functional  areas.  The  entire  sample  and  all  four  major  user 
categories  indicated  no  significant  differences  for  the 
following  areas: 

Offensive  ballistic  Missiles 
Aerodynamic  facilities 

Preliminary  ballistic  and  Space  Vehicle  Design 
Advanced  Systems  UDfjT  facilities 
Meteorological  Sciences  (Table  C .  1  1) 
fhese  areas  might  be  construed  as  dormant  for  the  future,  but 
must  not  be  neglected.  Continual  evaluation  is  imperative  to 
identify  shifts  in  the  user  community's  opinions, 

k  i  nd  s  ».>  t  Intel  1  i  ^nc e 

Kinds  of  intelligence  were  also  evaluated  tor  current 
and  future  importance  by  the  respondents.  The  degree  of  com¬ 
plexity  of  intelligence  data  ranges  from  single  event  to  more 
complex  integrated  intelligence  products.  The  most  important 
topics  appear  to  be  weapon  system  and  subsystem  performance 
and  capabilities  as  well  as  integrated  warfare  systems  threat 
assessments.  Ividence  of  this  importance  is  derived  from  the 
large  majority  of  individuals  indicating  that  these  three 
topics  arc  either  very  or  moderately  important. 

The  relative  changes  from  current  to  future  evaluations 
of  kinds  of  intelligence  identify  seven  of  the  nine  topics  as 
different  in  the  future  for  the  total  sample  (Table  C.l-2). 
of  interest  here  is  that  all  items  decreased  in  importance  in 


the  future. 


I  he  decision-makers  as  a  group  identify  only  the 
intelligence  event  as  different  in  the  future  (Table  C.2-2). 
The  importance  of  the  intelligence  event  decreases  in  the 
future  for  decision  makers.  The  remaining  eight  topics  were 
not  significantly  different.  lor  the  military  operators 
(Table  1.4-2),  again  all  items  decreased  in  importance  with 
only  the  biog raph 1 ca  l/organi za 1 1 ona 1  and  engineering  and 
production  technologies  not  significantly  different.  The 
intelligence  respondents  also  indicated  decreases  in  import¬ 
ance  tor  future  kinds  of  intelligence  (Table  C.S-2).  Basic 
Technologies  k  T,  I  *  and  Ingineering  Technologies  were  the  only 
two  items  where  no  significant  differences  existed  in  the 
future.  This  agrees  with  nam  comments  on  the  surveys  from 
intelligence  and  military  respondents  that  (III  products  are 
too  technical  and  should  be  written  such  that  users  can  more 
readily  understand  them.  The  military  and  intelligence  users 
are  driven  by  the  same  problem  of  having  to  apply  intelligence 
data  to  combat  situations  and  are  not  as  interested  in  the 
engineering  or  K f, I>  technologies  as  other  users. 

The  RM>  users  were  the  only  group  to  show  significant 
increases  in  future  importance  for  two  of  the  nine  topics 
(Table  (.3-2).  Basic  Technologies  R&D  and  Military  Doctrine 
and  Design  Philosophies  increased  in  importance  to  R&P 
respondents.  The  immediate  problem  in  kinds  of  intelligence 
is  that  Basic  Technologies  R&P  varies  between  our  major 
groups.  R&P  users  believe  in  future  increased  importance  in 


liable  Technologies,  and  military  users  place  a  decreased 
importance  on  the  same  item  in  the  future.  The  department 
involved  uith  Kt,P  technologies  should  he  aware  of  these  two 
types  ol  users.  Hie  only  other  major  difference  is  that  all 
users,  except  the  military  respondent s ,  indicated  biographical/ 
organ i :a t  iona  1  kinds  ot  intelligence  as  the  least  important 
among  the  nine  kinds  of  intelligence. 

Kepor  t  iii^;  to  rma  t 

the  respondents  were  asked  to  evaluate  six  foimats 
which  ilH  lias  used  tor  t  tie  i  i  leports.  If  a  user  indicated 
he  was  unfamiliar  with  a  particular  tvpe  of  format,  he  was 
eliminated  from  t  tie  eaKulations  comparing  current  and  future 
importance.  the  total  sample  indicated  that  the  weapon  system 
handbook  was  the  overall  most  impoitunt  format.  When  compared 
b.  primary  mission  categories,  the  decision  makers  and  R$P 
respondents  indicated  their  most  important  format  was  the  in- 
depth,  comprehensive  study  (see  1  a h 1 e s  f.2  3  and  C.3  3).  The 
least  important  item  tor  the  total  sample  was  the  computer 
data  base  (Table  (  .1  3).  1  he  computer  data  base,  however, 

did  have  the  greatest  change  to  increased  importance  in  the 
future.  As  a  group,  the  sample  indicated  all  reporting  for¬ 
mats  will  increase  in  importance.  The  weapon  system  acquisi¬ 
tion  threat  package,  computer  data  base,  and  briefing  by  an 
1  TP  analyst  were  the  only  formats  with  a  true  difference 
between  current  and  potential  importance  (Table  C.l-3). 

The  military  and  intelligence  respondents  were  the 
only  two  groups  that  showed  decreases  in  format  importance 


m  the  future.  lhese  decreases  were  not  significantly  differ¬ 
ent  from  current  ratings  of  importance.  for  the  military 
users,  decreases  were  evident  in: 

In  depth,  comprehensive  Study 
Weapon  System  \cquisition  Ihreat  Package 
Short  Report  of  Specialized  Subject  (Table  (' .  4  3) 
lor  the  intelligence  users,  a  decrease  in  importance  was 
evident  in  the  future  tor  the  Weapon  System  Handbook  reporting 
format  liable  C.S-3).  It  must  be  emphasized  that  these  de¬ 
creases  are  not  s i gn 1 1  i  c an t  1  >  different,  but  indicate  special 
attention  should  be  directed  to  investigate  these  areas.  The 
intelligence  users  exhibited  an  increase  in  importance  in  the 
future  tor  both  the  Computer  Data  Base  and  Vnalyst's  iriei ing 
reporting  formats  (Table  C . 5  -  3  I  .  These  increases  are  sigrn 
t leant  Is  d i f t crent . 

I  he  dec  is  ion  makers  and  Rf,I>  respondents  specified 
significant  differences  for  three  formats.  Decision  makers 
believed  Weapon  System  Vcquisition  Threat  Package  and  Computer 
Data  base  reporting  formats  would  increase  in  potential 
importance  (Table  C.2  3).  The  Rf»D  respondents  argue  that 
there  is  a  definite  difference  only  in  the  impottance  of  the 
In  depth.  Comprehensive  Study  (table  (.33). 

In  general,  there  arc  lew  differences  between  mission 
user  segments  regarding  reporting  formats.  It  appears  that 
handbooks  should  be  emphasized  more  for  military  operators, 
and  comprehensive  studies  should  be  stressed  for  decision- 
makers  and  Rf,D  users.  The  implications  point  to  the 
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intelligence  users  as  the  group  placing  the  most  importance 
on  computer  data  base  formats.  While  decision-makers  also 
believe  computer  data  base  formats  are  important,  they  are 
only  one- fifth  the  si;e  of  the  intelligence  group. 

Pi-.se in  1  n a t  i  on  Means 

1  he  Sf,T  Intelligence  Users  evaluated  the  current  and 
potential  importance  of  dissemination  method*,  that  influence 
their  ot i ice  needs.  Six  topics  were  evaluated: 

Courier  or  Ma i 1 
l  1 ec  t  ri  c  a  1  Transmission 
Hi  lefer  '  s  1’  resent  a  t  ion 
On-Line  Computer  link 
Off-line  Computer  l ape 

Off-Line  Computer  Printout  (Question  ’ ) 

The  overall  results  of  the  comparison  between  current 
and  future  importance  denote  true  increases  in  importance  for 
all  topics  except  courier  or  mail  (Table  (.14).  This  veri¬ 
ties  additional  findings  that  products  are  desired  more  often 
in  the  near  time  frame  and  used  more  frequently.  The  courier 
or  mail  topic  exhibited  the  highest  importance  rating  for  the 
average  of  all  respondents.  This  corresponds  to  the  immense 
volume  of  business  LTD  conducts  by  courier  or  mail.  Also, 
the  decrease  for  courier  or  mail  cannot  be  established  as  a 
significant  difference  by  use  of  the  Student's  t-test. 

The  intelligence  users,  as  the  largest  subgroup,  agreed 
with  the  total  sample  disclosures,  except  that  the  decrease  in 
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courier  or  mail  delivery  was  a  true  difference  from  current 
importance  (Table  l'. 5-4).  Military  operations  respondents 
indicated  a  slight  decrease  in  importance  for  briefer's 
presentations  (Table  C . 4  4 ) .  The  presumption  here  is  that 
a  lack  ot  ability  or  funds  to  acquire  the  needed  information 
m  person  has  driven  the  reference  to  decreased  importance. 

K tj  1>  users,  consistent  with  their  previously  dicussed  responses 
appraised  all  topics  as  increasing  in  importance  (Table  C.3-4) 
Ihey  did  not  indicate  significant  differences  between  current 
and  future  importance  in  courier  or  mail  transmittal.  The 
decision  makers  were  the  only  group  that  indicated  a  decrease 
in  electrical  transmission,  but  not  a  large  enough  difference 
to  indicate  other  than  a  random  chance  (i.e.,  not  significant) 

I  he  general  evidence  gained  t rom  this  data  indicates 
the  requirement  to  step  up  efforts  for  on-line  computer  tape 
dissemination  methods.  The  largest  ditferencc  from  current 
to  future  importance  of  the  six  methods  is  found  in  the  com¬ 
puter  tape  delivery  methods.  A  further  point  needs  to  be 
addressed  about  courier  or  mail  transmittal.  Postage  or 
courier  dissemination  should  not  be  halted,  but  possibly  an 
experiment  should  be  devised  to  attempt  to  eliminate  any 
increases  in  volume  or  expenses. 

1  Ise  r  Prof  i  1  cs 

Segments  of  the  I  Tl)  user  sample  were  identified  by 
evaluation  of  numerous  c ross- tabulat ion  tables.  No  assump¬ 
tions  were  made  in  advance  as  to  the  most  valuable  way  of 


looking  at  the  market.  Over  3S  different  suhsets  could  be 
distinguished,  and  these  were  compared  for  differences.  from 
these  subsets,  five  major  segments  were  large  enough  and 
distinct  enough  to  warrant  their  individual  evaluations. 

These  tive  groups  represented  7 7 1  of  the  sample.  The  re¬ 
maining  groups  were  evaluated,  but  their  results  are  not 
presented  because  their  small  size  (12  or  less)  compounded 
problems  of  verification.  The  third  section  of  this  chapter 
uses  discriminant  analysis  to  identify  distinguishing  pro¬ 
files  of  the  segments. 

Before  exhibiting  the  profiles  of  these  five  segments, 
it  is  necessary  to  identify  their  relative  sizes.  The  first 
group,  and  largest  segment,  represents  Air  force  respondents 
(excluding  HQ  USA!  users)  and  represented  3b l  of  the  sample. 
Ihis  group,  like  the  other  four  subsets,  is  derived  using 
major  organizational  affiliation.  The  Air  force  group  included 
all  respondents  associated  directly  with  this  branch  of  the 
military  except  HQ  United  States  Air  force  respondents.  A 
large  portion  (48\)  of  this  first  segment  is  composed  of 
members  of  Air  force  Systems  Command  (AFSC). 

The  second  segment  was  called  the  Unified  and  Specified 
Commands  (U&S  Commands).  IU,S  Commands  represented  2 0 1  of  the 
sample  and  included  responses  from  the  major  command  head¬ 
quarters.  CINCSOUTH  was  the  only  headquarters  not  responding 

and  not  included  in  this  group  (see  Appendix  B).  Headquarters 
* 

Army  and  Headquarters  Air  force  were  included  in  the  third 
segment . 
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The  third  segment  accounted  for  71  of  the  sample. 
This  segment  was  called  the  Washington,  DC  intelligence 
community.  The  Washington  community  included  the  State 


Department,  Joint  Chiefs  of  Staff  (JCS),  Office  of  the 
Secretary  of  Defense  (OSD),  Chief  of  Naval  Operations  (CNO) , 
Defense  Advanced  Research  Projects  Agency  (DARPA) ,  and  the 
Army  and  Air  force  Headquarters  mentioned  above.  The  fourth 
and  fifth  segments  include  the  remainder  of  the  Washington, 

DC  community. 

The  fourth  segment  was  called  the  Defense  Intelligence 
Agency  (DIA)  and  comprised  71  ol  the  sample.  The  fifth  seg¬ 
ment  was  identified  as  the  Central  Intelligence  Agency  (CIA), 
and  this  group  accounted  for  St  of  the  sample.  The  profiles 
for  these  last  segments  were  distinct  enough  to  allow  for 
their  separation.  Two  other  groups  of  respondents.  Navy  and 
Army,  were  not  homogenous  enough  in  their  responses  to  act  as 
single  segments.  No  attempt  was  made  to  weight  t tie  responses 
of  any  group,  and  these  segments  have  not  been  combined  in 
any  mathematical  manner  that  would  distort  their  distinct 
i  d  c  n  t  it  i  e  s  . 

lour  topics  were  of  immediate  interest  to  the  researcher. 
I'TD  must  know  what  time  frame  is  most  important  to  their  clients 
to  better  match  outputs  with  requirements.  Information  on  time 
frame  was  collected  from  Question  9  on  the  survey.  The  second 
topic  involved  the  reaction  time  of  users.  Data  on  the  clients’ 
normally  required  response  time  was  gathered  from  Question  12. 
The  third  topic  dealt  with  survey  respondents’  actual  use 
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(tor  themselves  or  for  others)  of  S$T  intelligence.  knowledge 
ot  topics  two  and  three  allowed  FTP  to  determine  the  produc¬ 
tion  schedule  necessary  to  satisfy  the  requirements  of  a 
particular  user,  and  what  segment  was  most  likely  to  be  a 
user.  The  fourth  topic  concerned  whether  or  not  respondents 
had  a  working  knowledge  of  the  Intelligence  Production  Require¬ 
ments  System  (U’KS). 

\  comparison  of  the  time  frame  ol  need  for  the  five 
segments  can  he  seen  in  I  able  4.1.  The  segment  with  the  most 
immediate  need  of  intelligence  information  is  the  Uf,S  Commands. 
1  ho  segment  whose  needs  are  iarthest  in  t  lie  future  is  the 
Washington,  PC  community.  Interesting  to  note  here  is  that 
MSI  (48t  of  the  \ii  lorce  segment)  actually  had  the  most  res¬ 
pondents  (12.61)  indicating  10  years  or  greater.  It  is  pre¬ 
sumed  that  the  large  numbers  of  RM'  personnel  within  AFSC 
account  for  this  high  percentage.  When  M  SC  is  combined  with 
the  remainder  of  Vir  lorce  respondents,  the  \ir  Force  segment 
becomes  the  second  largest  group  with  the  longest -term  time 
frame  of  need.  lhc  implications  of  this  knowledge  should  not 
be  misconstrued.  Iccrv  effort  should  be  made  to  accommodate 
each  time  frame  of  need.  A  small  number  of  respondents  needing 
information  based  10  years  or  more  in  the  tuturc  should  not 
necessarily  imply  limited  resources  should  be  allocated  to 
that  time  frame.  Only  in  light  of  the  values  input  from 
secondary  data  can  an  accurate  appraisal  he  made.  For  now, 
merely  identifying  the  segments  contributes  information  to 
the  total  system.  Missing  respondents  »orc  not  included  in 
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TABU.  4.1 


Percent  of  Respondents,  Described  by  Segments, 
Indicating  Time  Frame  of  Intelligence 
Information  Needs 


Segment 

\ 

2  Years 
or  Less 

l 

2-5 

Years 

l 

5-  10 
Years 

l 

10  Years 
or  More 

Air  For  c  e 

oo.o 

12.3 

20.9 

6.8 

IJ$S  Commands 

87.4 

0.7 

1  .  7 

4.2 

Washington,  DC 

54.3 

13.0 

23.9 

8.8 

DIA 

82 . 2 

4  .  4 

8.8 

4  .  4 

CIA 

81.3 

9.4 

0. 3 

3.0 

Total  Sample 

71.3 

10.0 

13.4 

5.4 

the  percentage  calculations. 

User  reaction  time  was  the  second  category  of  informa¬ 
tion  FTD  needed  to  further  identify  their  clients.  It  is 
assumed  that  if  a  user  has  a  very  short  suspense  time,  he 
most  likely  uses  "on  hand"  publications  and  documents  to  ful¬ 
fill  his  needs.  When  the  reaction  time  increases,  he  may  be 
able  to  obtain  the  needed  information  from  documents  procured 
through  quick  reaction  tasking  in  FTD.  A  shortfall  in  the 
design  of  this  question  is  that  respondents  were  given  too 
much  opportunity  not  to  make  a  decision. 

The  answer  "responsiveness  requirements  vary  with  no 
one  being  predominant"  is  a  perfectly  accurate  classifier, 
but  lends  only  limited  value  to  a  numerical  analysis.  For 
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example.  Table  4.2  indicates  that  51. 54  of  the  CIA  respondents 
have  reaction  times  that  vary.  This  does  not  disclose  any 
definite  information,  but  actually  compounds  the  problem  of 
trying  to  determine  usable  results.  The  only  factual  state¬ 
ment  that  can  be  made  is  that  the  response  time  for  CIA  users 
varies  more  than  all  other  users.  ITD  analysts  would  obtain 
more  definite  information  by  always  asking  the  user  to  identify 
a  specific  reaction  time  if  possible. 

The  Washington,  DC  community  indicates  a  need  foi  the 
shortest  reaction  time.  I  hi s  appears  to  disagree  with  their 
identification  oi  required  time  frame  as  being  the  longest 
range.  However,  no  assumption  should  be  made  that  establishes 
reaction  time  a^  dependent  upon  time  frame  of  need.  A  con¬ 
gressman  may  direct  an  aide  to  provide  information  in  less 
than  one  hour  about  a  project  15  years  in  the  future.  Any 
combination  of  need  time  frame  and  reaction  time  might  be 
plausible. 

The  IU|S  Commands  also  indicated  a  majority  of  users 
with  short  suspense  times.  The  large  overall  percentage  of 
respondents  with  short  reaction  times  validate  the  necessity 
for  ITD  to  provide  intelligence  products  in  a  more  timely 
manner  to  satisfy  users.  It  would  be  speculative  to  attempt 
to  identify  the  causes  for  these  immediate  user  needs;  how¬ 
ever,  the  overall  lack  of  users'  knowledge  and  ability  to 
make  a  formal  request  for  intelligence  information  using  the 
1PRS  is  a  contributing  factor. 
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tabu;  4.2 


Percentage  of  Respondents  Compared 


by  Reaction  Time  Available 


Segment 

X 

One  Week 
or  less 

X 

One  Month 
or  More 

X 

Varies 

4 

Missing 

\  i  r  For  c  e 

4  3.3 

24.4 

29.8 

2.5 

P^S  Commands 

63. 4 

8 . 0 

26.2 

2.4 

Washington,  PC 

74.  S 

8.6 

17.0 

0.0 

PI  A 

48.9 

10.6 

36.  2 

4 . 3 

C  1 A 

42.5 

• 

3.0 

51  .  5 

3.0 

Iotal  Sample 

l 

48  .  3 

17.6 

31  .  1 

3.0 

Only  the  Air  Force  segment  has  a  large  group  of  res¬ 
pondents  who  desire  FTP's  reaction  time  to  be  one  month  or 
more.  A  necessary  point  here  is  that  Air  Force  respondents 
who  identify  themselves  as  being  part  of  the  intelligence 
category  indicate  only  134  of  their  group  has  reaction  times 
of  a  month  or  more.  All  these  differences  can  lead  to  mass 
confusion.  The  best  single  solution  would  be  to  request  that 
users  identify  a  specific  date  the  information  they  requested 
should  be  delivered  to  meet  their  suspense  requirements. 

They  should  be  told  at  the  time  of  the  request  whether  or  not 
the  date  is  plausible  given  FTP  resources. 

Pata  on  frequency  of  use  of  intelligence  information 
was  requested  from  all  respondents  with  Question  13.  Respon¬ 
dents  were  asked  to  identify  how  often  they  used  S6T 


intelligence  or  extracted  SfcT  intelligence  for  the  use  of 
others.  The  total  sample  ind'cated  only  2. St  (In  individuals) 
never  used  S fi T  intelligence  (see  Table  4.3).  This  lends 
positive  evidence  to  the  composite  mailing  list  as  a  true 
list  ol  users  of  t  ID  produced  documents.  This  small  per¬ 
centage  of  non  users  most  likely  have  had  mission  changes 
or  could  be  new  personnel. 

1  he  Washington  community  has  the  largest  percentage 
ol  frequent  users  (once  or  more  per  week).  In  general,  this 
table  on  usage  frequence  is  the  most  homogenous.  A  majority 
ot  St,  I  intelligence  users  are  frequent  useis.  One  exception 
to  thi-.  uniformity  was  seen  when  the  question  was  broken  down 
in  greater  detail.  Only  30',  ot  the  Washington  community  uses 
St,  I  intelligence  Jail)  compared  with  5  2\  ot  the  IT  I A  segment's 
daily  use  of  Sf,T  intelligence. 

Question  15  from  the  survey  requested  that  users 
acknowledge  whether  or  not  they  have  a  working  knowledge  of 
the  Intelligence  Production  Requirements  System  (IPRS).  This 
system  was  established  by  D1A  to  help  manage  the  flow  of 
requested  intelligence  information.  Sew  requirements  are 
submitted  on  DD  form  1 4 7  for  approval.  Table  4.4  shows  the 
five  segments’  responses  to  knowledge  of  IPRs  with  missing 
respondents  eliminated  from  the  percentage  calculations. 

The  overall  low  response  to  Question  15  indicates  a 
problem  that  must  be  resolved.  As  expected,  D1A  has  the 
largest  group  of  users  with  knowledge  of  IPRS.  No  DOD-widc 
program  exists  to  explain  the  value  of  this  aid  to  intelligence 
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TABU  4.3 


Respondents'  Indication  of  Their  frequency 
of  Use  ot  Intelligence  Ini  urination 


I - 

Segme nt 

X 

Once  or  More 
Per  Week 

— 

X 

Monthly 
or  Less 

X 

N  e  v  e  r 

r- 

X 

Missing 

Air  lorce 

M  .  2 

3  5.5 

2.  1 

1 .  2 

tlfi  S  Commands 

69.1 

28 . 6 

1  .  6 

0.8 

■  Wa  sill  ng  t  on  ,  IB' 

74  .  5 

2S .  S 

0 . 0 

0.0 

'  IMA 

70. 3 

25.5 

2  .  1 

2  .  1 

I 

CIA 

72.7 

27.  J 

0 . 0 

0.0 

fetal  Sample 

M  .  7 

34  .  S 

l .  5 

1  .  2 

TABU  4.4 

Respondents'  Indication  Whether  or  Not  They 
Have  a  Working  Knowledge  of  the  Intelligence 
Production  Rcqu i rcmcnt s  System 


1 — - 1  “  I 


Segment 

X  Yes 

\  No 

\ i r  force 

32  .  2 

67.8 

Hf,S  Commands 

30 . 9 

69. 1 

Washington,  DC 

40.0 

60. 0 

IMA 

58.7 

4  1.3 

CIA 

21.2 

78.8 

Total  Sample 

37.7 

62.3 
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users.  lo  make  the  problem  more  difficult,  only  recently  has 
n  1 A  shifted  responsibility  of  the  management  of  IPRS  to  1  TI> 

(a  producer  that  serves  only  a  portion  of  the  intelligence 
c ommun 1 1  y ) . 

When  the  users  are  defined  inoic  closely,  the  largest 
percentage  of  knowledgeable  IPKS  users  are  the  Army.  Seventy- 
tour  percent  ot  Army  intelligence  respondents  indicated 
knowledge  of  IPRS,  while  on  1  \  Sb\  of  Air  force  intelligence 
respondents  indicated  1  now  ledge  of  ll'KS.  This  difference  is 
explained  bv  the  Arnv  '  explicit  training  of  its  members  in 
the  use  of  Il’Ks.  1  he  community  that  identifies  its  prim¬ 

ary  mission  as  intelligence  deviated  4t>.Hl  of  their  segment 
as  having  knowledge  i  t  fie  Il’K'  system.  The  reader  is 
reminded  that  the  above  \rm>  and  Ait  lorce  users  are  included 
in  the  POP  segment.  "I  he  non  Ik  P  respondents  (representing 
4s.  A*,  of  the  sample)  indicate  only  2(>.41  of  their  segment  as 
having  a  knowledge  of  the  ITU's  system. 

P  i  sc  r  i  m  i  nan  t  Pro  1  lie 

Discriminant  analysis  was  used  to  determine  tfie  questions 
that  differentiated  key  segments  of  the  FTP  user  sample.  The 
discriminant  procedures  used  were  part  of  the  Statistical 
Package  for  the  Social  Sciences  (SPSS).  The  predictive 
problem  in  discriminant  analysis  is  to  predict  to  which  group 
(segment)  a  subject  will  belong  on  the  basis  of  a  set  of  inde¬ 
pendent  variables  (the  way  the  respondent  answered  the 
questionnaire).  In  tins  analysis,  all  variables  were  initially 


available  to  entei  the  discriminant  function.  from  the 
results  ot  t  lie  overall  discriminant  function,  approximately 
twelve  variables  (those  with  coefficients  of  the  greatest 
magnitude)  were  identitied.  These  variables  were  then 
analyzed  in  smallei  sets  and  individually  to  derive  the  best 
c  1  a *>  s  i  t  1 1  a  t  i  on  function.  f  rom  this  classification,  an 
observci  can  identify  the  key  descriptors  that  maximize  the 
differences  between  the  collected  group’s  answers. 

lo  evaluate  the  Junction  for  predictive  power,  two 
nearly  i  ,ual  si.e  segments  containing  known  respondents  (not 
used  in  the  derivation  of  the  model)  were  classified.  A 
different  set  of  respondents  from  the  ample  was  used  to 
eliminate  bia  that  might  have  been  created  in  the  model 
building  p  rotes  .  Hie  re  is  .1  tendency  to  have  more  correct 
c  1  a  s  s  1  l  i v  a  t i on  with  a  classification  f  mu  t i on  w  hen  t  he  same 
grouj  i  s  classified  that  was  use.)  to  build  the  model.  A 
second  type  of  bias  deals  with  sampling  error,  and  is  also 
reduced  hv  dividing  the  sample.  ^iikc  an  adjusted  K‘  is  not 
available  as  in  regression  analysis,  splitting  the  sample 
compensates  in  patt  for  the  number  ot  dependent  variables 
involved.  rhe  confusion  rat  r  n  obtained  bv  applying  the 
classi  1  it  it  i  on  t  one  t i on  (estimated  I i om  the  ana  1 y s i s  samp  1 c ) 
to  the  validation  sample  reflects  the  function's  ability  to 
d i sc  r i r i na t  e . 

Ihe  contusion  matrix  is  really  a  "score  sheet”  for  the 
accuracy  of  the  classification  process.  The  fewer  the  mis- 
classifications  of  individuals  to  segments,  the  more  distinct 


or  dissimilar  the  user  groups.  lhe  Chi  square  statistic 
■> 

(  c“  1  was  used  in  analyzing  the  contusion  matrix  to  validate 
the  results  as  being  more  than  a  random  happening*  lhe 
Chi  square  statistic  was  also  used  to  indicate  whethet  or 
not  the  amount  ot  discriminating  information  used  in  the 
mode  1  was  s i g  n  i  t  1 c an  t . 

Many  di  tier  cut  gioups  were  analyzed  in  an  attempt  to 
1  dent  i  t  v  key  cha  rac  t  e r l  tics.  1  wo  sets  o  t  analysis  will  he 
presented  that  give  a  "hig  picture"  view  ol  the  intelligence 
use:  s  -erred  !•  v  1  IP.  lhe  first  groups  observed  were  ldentj- 

tied  hr  ell  i e  ponsi  to  question  2  on  the  survey.  These 

loui  gioups  i  Pec  i  sion  rakers,  kf,p  users.  Military  Operations 
users,  and  Intelligence  a  ■  e  r  s |  weie  individually  grouped,  and 
then  a  ran  dor  i  lecti  >n  function  oi  >l’kS  gathered  samples 
t l om  the  two  I  a i  . e  t  gioups  to  make  the  segment  sizes  equal. 
Ibis  allowed  the  anal,  fs  to  readil>  evaluate  the  predictive 
.»f>  ilits  ot  tin  ode  1  with  the  probability  of  group  memberships 
being  equal.  \pp rox  i  r a t e  1  >  hb  respondents  were  placed  in  each 

segment.  lhe  second  gioups  evaluated  were  all  intelligence 
users  (iron  Question  »),  and  furthei  distinguished  either  as 
\ir  lorce  respondents  i  llmtied  and  "specified  Command  respond¬ 
ents.  lhe  \ii  lore r  respondents  totaled  101  in  this  segment, 
and  the  Wfts  Command  respondents  totaled  80. 

lhe  ke*  discrn  inatois  were  first  used  to  separate  the 
four  segments  responding  to  Question  2.  Only  weak  results  were 
obtained  in  the  iirst  analysis  using  the  classification 
function;  the  Decision  makers  (PM)  and  K&P  users  also  having 


similar  characteristics.  1'ach  group  was  then  compared  with 
one  of  the  other  groups,  and  again  the  discriminators  pre 
dieted  v* e  1  1  between  1>M  and  Military  useis  01  DM  and  Intelli¬ 
gence  users;  but  not  well  between  DM  and  R^D  users.  likewise, 
predictions  between  R!<D  users  and  Military  users  or  R ti D  users 
and  Intelligence  users  were  more  accurate  than  predictions 
between  Military  users  and  Intelligence  users.  To  simplify 
the  discussion  and  group  like  respondents  together,  an  arbi¬ 
trary  name  ot  Planners  will  be  defined  as  respondents  who 
answered  Question  2  as  DM  or  Kf.D  users.  The  name  Workers 
will  be  an  arbitrar>  noun  defining  Military  users  and 
Intel  1 i gene e  users. 

1  he  analysis  between  Planners  and  Workers  provided  the 
basu  outline  to:  the  key  disci  imnator>.  The  following  pro¬ 
tiles  are  discussed  for  both  Planners  .ind  Workers  with  each 
of  the  k e v  discriminators: 

\crodynamu  facilities  the  worker  segment  specified 
more  importance  for  aerospace  facilities  than  the 
planner  segment.  lhis  difference  is  statistically 
significant  with  t  •  2 .  y  5 ,  p  .004. 

\n t i - sa t c 1 1  1 1 c  Systems  the  planners  indicated  anti- 
satellite  systems  as  more  important  to  their  group 
than  did  the  workers  (t  *  l.b5,  p  s  .104). 

Directed  1 nergy  the  planners  indicated  directed 
energy  technologies  and  systems  as  significantly 
more  important  to  them  than  the  workers  (t  *  5.12, 


Intelligence  I  vent  the  workers  denoted  significantly 
more  importance  to  their  offices  lor  intelligence 
event"  than  did  the  planners  (t  •  4.49,  p  .000). 

l.ng  i  ncc  r  i  ng  and  Production  Technologies  t  lie  planners 
spec i tied  that  engineering  technologies  were  more 
important  to  them  than  did  the  workers  (t  ■  2.92, 
p  "  . 004  |  . 

I  l ec t  i  ical  1 i a n sm i ss i on  disstmi na t i on  b>  electrical 
transmission  was  more  valuable  (important)  to 
workers  than  planners  |t  *  S.KO,  p  ■  .000). 

Need  line  (rare  the  ajoritv  of  workers  identified 
theii  time  t i amc  ol  need  as  0  •  2  years  or  near 
realtime.  1  he  planners  marked  their  tine  frame  of 
need  in  the  2  S  year  span  It  ■  11.00,  p  *•_  .000). 

Reaction  liri  the  workers  specified  the  time  required 
to  acquire  i  lit  orraa  t  i  on  as  a  tew  hours  or  less.  The 
plannei  >  general 1\  had  a  longer  reaction  time  of 
a  tew  da  ns  to  a  week  (t  ■  6 .  1 6 ,  p  .000). 

Usage  frequency  the  workers  were  heavier  users  of 
aerospace  SM  intelligence  than  the  planners. 

Workers  generally  indicated  usage  as  several  times 
per  week  while  planners  specified  usage  as  once  per 
week  or  less  (t  ■  5.90,  p  ■  .000). 

Methodology  methodology  was  more  important  to  the 
planners  than  to  the  workers  it  •  4.19,  p  <  .000). 

When  all  the  above  discriminators  were  entered  into 

■> 

the  model,  a  Chi  square  (x  )  value  of  SO. 79  (p  "  .000)  resulted. 


This  indicate**  a  statistically  significant  amount  of  dis¬ 
criminating  information  was  present.  fchen  these  variables 
were  analyzed  in  smaller  sets,  K"  only  decreased  to  48.672 
(still  a  significant  amount  of  in  format  ion)  with  just  three 
variables  in  t  lie  model.  Ihese  variables  were  directed 
energy,  need  time  frame,  and  ant i -  sat e 1 1 1 1 e  systems, 
lohle  4.S  exhibits  the  confusion  mat  i  u  that  resulted  with 
these  three  variables  in  the  model.  lhus,  the  discriminant 
analysis  exposed  the  variables  w i t h  the  greatest  differences 
between  groups.  Ihe  three  vat  table  model  was  a  very  good 
predictor  for  the  worker  segment.  I  fie  model  was  less  effect 
ive  in  predicting  t  fie  planner  segment.  One  interpretation 
tor  this  is  that  there  are  some  similarities  exhibited  by 
planners  that  match  them  more  with  workers.  1  he  second  dis¬ 
criminant  results  continue  to  vcrif\  the  power  of  identifying 
variables  that  maximize  differences  between  segments. 

Many  of  the  same  discriminators  were  used  to  separate 
the  V i i  lor^e  Intelligence  t  Vf  I )  respondents  and  the  Unified 
and  Specified  Command  Intelligence  ( lift  St'  f )  respondents.  The 
analysis  between  \ir  force  Intelligence  users  and  lUiS  Command 
Intelligence  users  identified  their  profiles  with  the  follow¬ 
ing  kev  discriminators: 

Preliminary  Ballistic  and  Space  Vehicle  Design  -  the 
Af I  users  indicated  space  vehicle  design  was  more 
important  to  their  office  than  did  the  U&SCI 
users  (t  *  1.8S,  p  <  .066). 


Directed  Incrgy  although  not  significantly  different 


TABU  4  .  S 


Predict  i  ve  Results  3  Variable  Model 
Contusion  Matrix  for  Planners  and  Workers 


Segment  \  of  Cases 

Predicted  Croup  Membership 

P 1  a  n  n  e  r  s 

Workers 

Planners  59 

44 

74.03 

15 

25.43 

Workers  o  3 

i 

10 

15.91 

53 

84.13 

^9.5  percent  of  known  cases  correctly  classified 
> 

(n“  -  42.492,  p  v  .000) 

there  weie  still  enough  high  and  low  scores  to 
indicate  that  directed  energy  is  more  important  to 
AF 1  ( t  -  1.38,  p  -  .  1  -  1  )  . 

1 «  and  C  Threat  Simulator  Validation  the  All  users 
placed  greater  importance  on  simulator  validation 
than  did  the  UiiSCl  users.  This  is  an  unexpected 
difference  in  the  opposite  direction  (t  •  2.73, 
p  <  .007). 

Short  Report  this  reporting  format  was  the  most 

important  to  U&SCI  users,  however  not  enough  evidence 
exists  to  distinguish  this  fact  statistically 
(t  -  0.54,  p  •  . 59) . 

Courier  or  Mail  Pi ssem mat  ion  the  ATI  users  specified 
mail  distribution  as  more  important  to  their  segment 
than  the  importance  attached  by  the  ll(SCI  users 
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It  -  2.40,  p  v  .017). 

Need  Time  I  ramc  the  UtjSCI  users  needed  S£T  intelli¬ 
gence  iniormation  in  a  closer  than  0  2  year  span 

than  did  the  All  users  (t  -  1.78,  p  <  .077). 
Methodology  methodology  was  more  important  to  the  A 1- 1 
users  than  to  the  1 1  f,  SC  I  users  (t  •  2.40,  p  <  .017). 
Managing  i  rises  lit* St:  1  users  indicated  managing  crises 
.is  more  impoitant  to  them  than  did  the  AM  users 
It  -  V.  '8  ,  p  s  .  000)  . 

When  all  the  above  discriminators  were  entered  into  the  model, 
a  i  hi  square  (x~)  value  of  15.83  (p  <  .26)  was  obtained.  This 
indicates  a  lesser  amount  of  discriminating  information  was 

present  than  in  the  first  analysis.  When  these  variables  were 

•» 

further  analyzed,  » . "  decreased  to  5.804  (p  <■_  .122)  with  two 
variables  m  the  model:  I  h  and  ("^  Threat  Simulator  Validation 
and  Short  Report  on  a  specialized  subject. 

I  able  4.6  displays  the  confusion  matrix  that  resulted 
with  just  these  two  variables  in  the  model.  In  comparing 
this  model  with  the  previous  model,  one  i  an  sec  that  the  common 
discriminators  are:  methodology,  need  time  frame,  and  directed 
energy.  Specific  differences  arise  where  questions  that  relate 
to  the  particular  user  segment  have  the  most  meaning.  Space 
vehicle  design  is  currently  more  of  an  applied  field  and, 
thus,  deals  with  intelligence  users  to  a  larger  extent  than  it 
would  with  Rf,l>  users  or  decision-makers.  Need  time  frame, 
although  a  common  discriminator  for  both  models,  is  not  as 
effective  in  this  last  model.  This  is  largely  due  to  the 
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TABU  4.6 


Confusion  Matrix  for  Air  force  and  Unified 


and  Specified  Command  Intelligence  Users 


Segment  N  of  Cases 

Predicted  Group  Membership 

A  F 1 

UfiSC  I 

AM  49 

37 

7S.  5t 

-  .  J 

12 

24.51 

utist:  i  4  s 

.. 

42.21 

26 

57.81 

67.0  percent  of  cases  correctly  classified 
(  X2  -  10.894  ,  p  .001) 

similarity  among  intelligence  users  of  near  realtime  or  0-2 
year  time  frame  of  need.  The  similarity  of  intelligence  users 
also  accounts  for  the  relative  weakness  of  the  classification 
function.  With  so  few  variables  that  differentiated  well 
between  the  two  segments  and  most  of  the  differences  weak 
themselves,  the  results  arc  still  valuable  because  only  slight 
differences  are  needed  to  create  planning  strategies  to  satisfy 
specific  users.  Another  indication  of  the  homogeneity  within 
the  intelligence  segment  is  the  closeness  of  the  AF1  and 
U6SCI  group  centroids. 

Produc  t  1 va 1 ua t i on 

No  specific  products  were  identified  on  the  survey  for 
evaluation.  This  was  done  in  order  to  obtain  the  largest 
number  of  responses  without  eliminating  a  specific  product. 


An  area  was  provided  for  respondents  to  indicate  the  product, 
if  any,  they  were  evaluating.  One  hundred  fifteen  (115) 
distinct  products  were  evaluated  by  association  with  their 
Document  Short  Title  (DST)  numbers.  These  products  were 
evaluated  by  269  respondents  (41.81  of  the  sample).  When  the 
responses  were  tabulated,  119  evaluations  were  made  on  just 
12  products.  These  12  products  were  considered  the  most  used 
items  and  were  the  main  subject  of  this  analysis.  These  12 
products  were  produced  by  FTD  and  sponsored  by  DIA.  There 
were  approximately  150  respondents  who  made  general  evalua¬ 
tions  by  not  identifying  a  specific  product.  It  is  assumed 
that  this  group  of  respondents  made  their  evaluations  gener¬ 
ally  concerning  all  the  products  they  used  (or  they  could  not 
remember  the  DST  number).  In  total,  400  users  evaluated  pro¬ 
ducts,  or  nearly  two-thirds  of  the  sample. 

This  discussion  is  organized  by  first  giving  a  general 
overview  of  Question  27,  Parts  (1)  and  (2).  Following  this 
will  be  the  12  most  used  products  and  their  evaluations.  The 
third  area  identifies  differences  between  DIA  sponsored  and 
non-DIA  sponsored  products.  The  topics  evaluated  were  out¬ 
lined  in  Chapter  III  and  will  be  identified  throughout  this 
process . 

Currency  and  Production  Frequency.  The  first  topic 
deals  with  the  currency  of  products  and  production  frequency. 
A  majority  of  respondents  (62.81)  indicated  that  routine 
information  should  be  available  that  identifies  whether  or 
not  a  document  is  current.  This  point  is  particularly  true 
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tor  the  DIA  sponsored  products.  For  the  non-DIA  sponsored 
ill)  products,  53.  91  of  the  respondents  desired  a  method  that 
indicated  product  currency.  More  of  the  respondents  stated 
non- DIA  sponsored  products  were  causing  no  problems  with 
currency  (42.71)  than  stated  DIA  sponsored  products  caused 
no  currency  problems  (32.01).  I  he  implications  surrounding 
product  currency  are  numerous.  Multiple  causes  and  effects 
must  be  considered  for  each  product.  Some  possible  solutions 
to  this  problem  are  discussed  in  Chapter  V.  A  compounding 
problem  concerning  product  currency  arises  when  the  document 
is  first  disseminated.  A  limited  number  of  respondents  (24.01) 
to  the  DIA  sponsored  section  indicated  that  data  in  the  publi¬ 
cations  should  be  more  current  when  initially  disseminated. 

Only  18.41  of  the  respondents  who  evaluated  the  non-DIA 
sponsored  products  indicated  documents  should  be  more  current 
when  disseminated.  One  can  infer  from  this  that  FTD  products, 
not  sponsored  by  DIA,  are  generally  more  current  at  the  time 
of  dissemination  than  DIA  sponsored  products.  The  problem 
needs  to  be  defined  to  a  greater  extent  in  order  to  determine 
why  the  DIA  sponsored  documents  lag  in  currency. 

One  half  of  the  survey  respondents  for  both  DIA  and 
non-DIA  sponsored  products  stated  that  production  frequency 
should  be  determined  by  intelligence  developments  concerning 
the  subject  document.  The  present  production  frequency  is  on 
a  periodic  schedule  (usually  yearly).  The  next  largest  group 
of  respondents  (301),  again  for  both  DIA  and  non-DIA  spon- 

t 

sored  products,  stated  that  present  production  frequency 
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caused  them  no  specific  problems.  The  remainder  of  the 
respondents  indicated  a  specific  frequency  of  production 
they  desired,  ranging  from  once  every  three  months  to  once 
every  24  months.  The  largest  portion  of  this  group  indi¬ 
cated  every  12  months  for  desired  production  frequency. 

Ihese  results,  combined  with  the  above  currency  information, 
indicate  users  are  willing  to  hold  and  continue  to  use  a 
document  as  long  as  they  can  be  certain  that  what  they  have 
is  still  current  or  that  no  unusual  developments  have  occurred 
which  would  have  a  hearing  on  the  subject  material.  This 
implies  that  elimination  of  mandatory  production  frequencies 
would  be  acceptable  to  users  if  information  about  currency  of 
data  was  available. 

lwe 1 ve  key  Products 

Table  4.7  lists  the  twelve  products  evaluated  by  441 
of  the  respondents  who  listed  specific  DST  numbers.  The 
product  names  used  in  this  discussion  are  the  product  short 
names  found  in  the  table.  The  product  most  evaluated  was  the 
lighter  Aircraft  Handbook  (43).  The  remaining  products  were 
evaluated  by  at  least  five  different  users.  All  the  products 
identified  were  D1A  sponsored  documents  produced  by  FTO. 

These  products  were  evaluated  for  subject  and  textual  content 
with  a  series  of  questions  that  requested  the  respondent 
identify  if  the  product  needed  increased  or  reduced  emphasis. 
The  respondent  was  also  provided  the  opportunity  to  mark  if 
the  product  was  adequate  with  regard  to  the  question  or  if 
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the  product  w.is  not  related  to  the  question. 

— - TTTsToTi c a 1  development  of  the  intelligence  topic  was 

the  first  point  of  evaluation.  Overall,  '’8.4*  of  the  respond¬ 
ent''  rated  this>  area  ax  adequate.  Three  products  received 
an  adequate  response  from  100*  of  the  participants:  these 
were  the  Back! ire  W/S,  I iddler  W/S,  and  Foxbat  W/S.  The  only 
product  that  possibly  could  need  expanding  in  this  area  is 
the  forger  W/S.  The  reader  is  reminded  that  most  of  these 
products  have  only  five  proclaimed  users.  It  is  risky  to 
generalize  about  the  products  evaluated,  but  every  customer 
1-.  valued  by  l  ip;  those  who  feel  changes  need  to  he  made  have 
already  been  or  will  be  contacted. 


The  equipment  description  also  shows  a  majority  of 
adequate  responses  (71.4*).  The  missile  payloads  document 
exhibits  the  largest  number  of  adequate  responses.  The  re¬ 
mainder  of  the  responses  called  for  increased  emphasis  of 
equipment  descriptions.  The  facilities  description  does  not 
apply  to  many  of  the  products,  but  is  considered  adequate  by 
respondents  who  evaluated  facilities.  No  product  stands  apart 
from  any  other  when  evaluated  for  facilities. 

The  total  system  descriptions  were  adequate  for  67.8* 
of  the  respondents.  The  remaining  respondents  wanted  increased 
descriptions  with  only  the  Fiddler  W/S  having  all  respondents 
score  it  as  adequate.  Three  of  five  evaluators  for  the  Hack- 
fire  K/S,  1  logger  W/S,  and  Forger  W/S  wanted  increased  emphasis 
on  the  total  systems  descriptions.  The  subsystem  description 
was  also  ranked  adequate  by  a  majority  of  users.  The  exceptions 
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were  lionet  W/S  aiui  loiter  W/S,  which  again  showed  three  ot 
live  evaluators  requesting  increased  emphasis. 

I’rodiict  liardware  charactei  i  sties  were  adequate  lor  a 
majority  ol  respondents.  I' he  only  exception  was  the  Backfire 

W/S,  loi  which  three  ol  live  evaluators  requested  increases 
m  characteristics  explanation.  facilities  characteristics 
were  considered  adequate  by  ol  the  evaluators  with  no 

unusual  responses  to  any  particulai  product. 

I'e  r  tormance  spec  i  1  icat  ions  showed  that  evaluators  took 
t*o  l  irn  positions.  The  Bomhei  Aircraft,  I  lddler  W/S,  and 
1  ol'yei  W  S  were  all  ranked  adequate  by  a  large  majority. 
Hesponses  concerning  the  I  lo^er  W/S  reflected  that  lour  of 
live  evaluators  desired  an  increase  in  its  performance  speci 
lications.  Ihe  remaining  products  weie  generally  split  with 
halt  the  evaluators  indicating  increase  and  half  indicating 
adequate.  Ihe  overall  ranking  for  adequate  pe i f o rmanc e 
specifications  was  5t>.M. 

Imployinent  tactics  is  the  only  subject  area  shire 
evaluators  more  often  Than  not  chose  increased  emphasis  rather 
than  adequate  (by  S2.1>).  Specifically,  the  Aircraft  Handbook 
evaluators  all  (S)  indicated  increased  emphasis.  Two  products, 
Missile  Payloads  and  loxbat  W/S,  had  the  majority  of  their 
evaluators  mark  adequate. 

Both  Deployment  and  future  Projections  subject  areas 
were  split  with  half  of  the  users  indicating  products  as  ade¬ 
quate  and  half  indicating  increase  emphasis.  The  Aircraft 
Handbook  and  1  CM  capabilities  products  were  evaluated  with 
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the  majority  ot  useis  a-.  desiring  increased  emphasis. 

I  he  textual  content  ut  the  products  was  evaluated 
next  with  no  products  differing  significantly  from  the 
nia  i  o  r  1 1  >  .  Over  8  0  *  oi  the  evaluators  indicated  summary  and 
background  data  as  currently  adequate.  The  evaluators  also 
stated  fonv lusions  and  analytical  rationale  were  adequate, 
hut  t  a  lesser  extent  (b?’.  ).  Ihe  products'  textual  supple¬ 
ments  all  were  evaluated  alike  with  ’’III  o  more  of  t  lie 
lespondents  giving  adequate  as  their  answer.  Ihe  only  unique 
i  t ei  here  is  with  the  lightei  \ircraft  Handbook,  2SI  of  the 
users  requested  reduced  emphasis  foi  graphs  and  curves.  This 
agrees  with  raanv  of  the  written  comments  that  users  want  less 
technical  emphasis  and  tcwei  graphs,  which  are  valid  only  at 
the  subject  aircraft's  t light  level  and  not  useful  at  engage- 
men  t  .ilt  it  ude  s  . 

The  last  area  of  evaluation  is  a  comparison  between 

the  PI  V  sponsored  products  and  the  non  PIA  sponsored  products. 

Slightlx  more  than  TTU  respondents  evaluated  the  PIA  sponsored 

products  and  approximately  21b  users  evaluated  the  non  PIA 

products.  The  subject  area  emphasis  was  generally  equal  to 

the  previous  evalunti  >ns  of  the  twelve  products.  The  non-PIA 

sponsored  products  exhibited  t  M  greater  responses  for  the 

adequate  value  in  the  following  topics: 

iacilities  Pescnption 
lac i 1  it i es  Charac  ter  l  s  t  1  c  s 
Imployment  Tactics 
Pep  1 ovmen  t 
1 uturc  Projec t ions 
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1  lie  1>!\  sponsored  products  generally  were  evaluated  similar 
1 1)  theii  non  1>1  \  sponsored  counterparts,  except  they  showed 
3  4»  latter  i  espouses  lor  the  adei(uate  value  associated  w  i  t  h 
the  textual  section  in  the  following  topus: 

Sum  in  a  r  > 

It i  aw  i  n^s 

liie  graphs  and  onves  catejjori  in  the  textual  section  was  the 
on  1  v  topic  evaluated  with  a  la  rjjei  percentage  ol  respondents 
stating  adequate  hv  non  I '  I A  sponsored  |  roducts.  The  remaining 
categories  were  equally  rated,  usual h  with  dilferences  of  It 


or  less. 


Conclusions  and  Recommendations 


I h i s  thesis  presents  and  interprets  the  results  of  the 
llT7‘J  lilt  Mil  Intelligence  User's  Questionnaire.  The  study 
was  essentially  a  market  analysis  in  the  government  arena. 

This  work  differs  from  other  related  literature  in  that  its 
primary  interest  is  restricted  to  researching  a  selected  set 
of  actual  product  users  ot  ITl).  I'he  approach  taken  was  general 
in  nature  and  attempted  to  involve  all  aspects  of  knowledge 
concerning  the  clients  ot  III).  \  summary  of  the  1  Hidings  will 
he  presented,  followed  by  specific  recommendations  and  their 
contributions  to  the  organ i :a t ion - c 1  lent  relationship.  The 
conclusion  ot  this  chapter  provides  suggested  topics  for 
future  longitudinal  efforts  and  proposes  further  research 
topics . 

Summary  of  Results 

The  reader's  initial  introduction  to  the  ITD  user  was 
presented  as  a  comparison  of  respondents'  appraisals  of  import¬ 
ance  between  current  and  future  topics.  The  overall  evaluations 
of  the  respondents  were  collected  into  four  major  mission 
categories  and  each  was  evaluated  separately.  The  topics 
stressed  as  most  important  or  changed  to  the  largest  extent 
for  the  functional  areas  of  aerospace  Sf,T  intelligence  were: 

1.  Directed  Fnergy  Systems 

2.  Defensive  Radar  Systems 


3 .  l.lectronic  Countermeasures 

4.  1W  a nd  l Threat  Simulator  Validation 

5.  Fighter  Aircraft  System*. 

b.  Integrated  1  lcctromagnet  ic  Systems 

When  the  remaining  topics  were  evaluated,  they  pointed 
toward  the  Ht(l>  user  as  the  single  most  influential  user  of 
1  Til  products.  The  largest  increases  m  importance  lor  luture 
requirements  fell  under  the  topics  of  Weapon  System  Threat 
Package,  Computer  Data  Base,  and  Analyst's  briefings  lor 
reporting  formats.  The  dissemination  means  stressed  as  most 
important  were  courier  or  mail  transmission,  with  the  largest 
difference  for  increased  future  importance  under  the  on-line 
computer  tape  method  of  dissemination.  In  general,  handbooks 
were  more  important  to  a  majority  of  users,  and  comprehensive 
studies  were  most  desired  by  KM>  respondents. 

Ihc  need  time  frame  for  a  large  majority  of  users 
(71.31)  is  less  than  two  years.  This  fact  alone  identifies 
a  possible  planning  problem  when  compared  to  present  guide¬ 
lines  directing  an  increased  effort  supporting  intelligence 
needs  for  five  years  or  more  in  the  future. 

Response  time  for  users  varied  between  groups,  but 
the  generally  short  suspenses  were  interpreted  as  a  driving 
factor  in  the  increased  number  of  requests  for  quick  reaction 
tasks.  These  short  suspense  times  were  identified  as  surro¬ 
gates  for  more  formal  requests  for  intelligence  information 
using  the  Intelligence  Production  Requirements  System.  The 
overall  lack  of  knowledge  concerning  the  1PRS  was  a  surprising 
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tact.  1  In  s  should  tu-  an  area  of  immediate  attention. 

Usage  frequency  was  investigated  for  various  clients. 
The  Washington  community  of  FTP  users  identified  themselves 
as  the  most  frequent  customers,  with  the  t!  1 A  using  St*  1 
intelligence  daily.  The  KfjP  users  are  apparently  more  special 
izcd  and  generally  use  intelligence  information  once  a  week  or 
less. 

Discriminant  analysis  was  used  to  further  identify  the 
profile  of  an  HP  customer.  It  was  found  that  the  sample 
population  could  be  divided  into  two  major  groups  arbitrarily 
named  Planners  and  Workers.  Ihese  groups  consisted  of  speci¬ 
fic  types  of  respondents  and  were  best  described  by  time  frame 
of  need.  \1  and  II f, S  Command  respondents  were  taken  t  rom  the 
intelligence  sample  and  analyzed.  The  Air  force  segment  was 
more  interested  in  IW  and  C  ^  Threat  Simulator  Validation. 

The  Unified  and  Specified  Command  segment  was  most  interested 
in  the  Short  Report  on  a  specialized  subject. 

lastly,  the  product  evaluation  indicated  a  need  for 
improved  methods  of  identifying  currency  of  publications,  and 
generally  stated  that  products  need  only  be  updated  when 

S 

major  changes  have  occurred.  Twelve  specific  products  were 
identified  and  evaluated.  The  IMA  sponsored  products  were 
compared  with  the  non  IMA  sponsored  products  (both  produced 
by  FTP),  and  only  very  slight  differences  were  observed. 

In  general,  respondents  appeared  to  have  responded  to 
the  survey  thoughtfully,  with  many  making  positive  comments. 
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i  oiu.  lus  ions  anil  Kei onmcndut ions 

The  primary  contribution,  with  respect  to  this  investi¬ 
gation,  was  an  initial  attempt  to  incorporate  consumer  needs 
and  requirements  with  management  strategies.  Much  was  learned 
about  the  1  11)  client  that  before  was  merely  speculated.  This 
study  represents  a  first  step  toward  explicitly  evaluating 
the  benefits  of  market  research  for  the  foreign  Technology 
Division  of  V 1 i  force  Systems  Command. 

Recommcndat ion  *1.  A  marketing  manager  should  be 
designated  within  fTD  to  continue  future  consumer  evaluations. 
This  manager  would  integrate  secondary  information  with  research 
data  concerning  clients.  This  manager  should  have  knowledge  of 
the  fTD  work  system  and  authority  to  direct  marketing  activi¬ 
ties.  He  or  she  would  he  responsible  for  "picking  lip"  where 
this  thesis  stops. 

Recommcndat ion  *2.  Immediate  attention  should  be 
directed  toward  developing  and  maintaining  an  information 
system  that  allows  users  to  verify  the  currency  of  intelli¬ 
gence  products.  This  effort  should  be  initiated  using  fTD 
related  products  and  then  expanded  to  DOD  or  a  national  level. 
Possibly  the  library  function  at  fTD  could  tabulate  the  titles 
and  with  further  coordination  the  information  could  be  dis¬ 
seminated  to  users  on  a  periodic  basis.  Almost  any  system 
would  be  an  aid  and  possibly  would  decrease  the  number  of 
quick  reaction  tasks  by  informing  users  of  current  data  on  hand. 

Recommendation  *5.  A  training  program  (much  like  adver¬ 
tising)  should  be  established  to  educate  users  as  to  the 
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purpose  of  the  Intelligence  Production  Requirements  System 
and  its  operating  characteristics.  It  is  possible  that  there 
are  other  problems  with  the  1PRS  within  the  intelligence  com 
munity.  It  so,  eliminating  these  may  contribute  to  increased 
usage. 

Reconmendu t 1  on  *J.  Resolve  the  available  information 
concerning  computer  systems  needed  by  users.  This  would  be 
a  good  ta>k  for  the  new  marketing  manager.  Specific  data 
should  be  combined  relating  the  following  computer  systems 
now  in  use: 

1.  l.lectronic  Warfare  Integrated  Reprogrammable  Pata 
Rase  { 1 K  I  R ) 

2.  Central  Information  Reference  and  Control  (CIRC) 

3.  Community  On-Line  Intelligence  Systems  (COINS) 

The  specific  needs  of  the  users  for  each  of  these  systems 
should  be  studied. 

Recommendat  ion  *_5.  Investigate  the  possibility  of 
expanding  the  production  of  short  summary  or  executive  type 
documents.  Many  users  specifically  stated  a  high  importance 
for  these  types  of  products.  These  results  were  also  confirmed 
by  numerous  personal  comments. 

Recommcnda  t  i  on  .  Because  many  respondents  indicated 
a  decrease  in  importance  of  courier  or  mail  dissemination 
means,  an  experiment  should  be  made  to  intentionally  redirect 
a  percentage  of  courier  or  mail  traffic  via  another  dissemina¬ 
tion  channel.  Cost  savings  may  be  significant  and  favorable 
consumer  acceptance  might  be  a  secondary  effect  due  to 
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Hue  to  the  volume  of  data,  many  additional  recommenda¬ 
tions  and  conclusions  can  be  drawn.  The  volume  of  information 
available  to  the  researcher  in  a  marketing  study  like  this 
could  be  studied  over  a  long  period  of  time.  Useful  exten¬ 
sions  of  this  work  will  identify  suggested  longitudinal  efforts 
and  some  specific  recommendations  of  their  imp  1 ement at  ion . 

Suggest  ions  for  further  Research 

The  respondents  to  the  ITU  survey,  through  numerous 
comments  and  responses  to  questions,  indicate  a  requirement 
of  intelligence  information  on  foreign  employment  tactics. 

Most  of  those  users  were  military  operations  people  who  also 
did  not  want  information  presented  in  too  technical  a  language. 
Specific  research  should  be  implemented  to  ascertain  how  the 
intelligence  employment  tactics  of  foreign  countries  can  be 
made  available  to  the  United  States  Intelligence  community. 

A  second  suggested  area  of  investigation  would  he  into 
composite  structure  of  the  intelligence  network.  Many  of  the 
problems  faced  by  this  researcher  were  generated  due  to  the 
relations  between  intelligence  organizations  being  poor  and 
many  times  more  secretive  than  the  information  they  held.  No 
single  address  register  exists,  and  the  lines  of  authority  and 
responsibility  sometimes  allow  agencies  to  act  almost  independ¬ 
ently.  Most  likely,  this  investigation  would  he  classified. 
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but  the  benetits  ot  knowing  who  works  tor  whom  and  why  could 
eliminate  many  redundant  el  torts.  Also  of  benefit  would  be 
the  ability  ot  one  service  agency  to  identify  other  investi¬ 
gators  in  their  tie  Id  with  a  clear  indication  of  how  to 
approach  these  other  agencies  for  mutual  benefit. 

A  third  suggested  area  involves  replication  of  parts 
ot  ttii-'  study.  Data  collected  after  a  one- year  period  can 
be  compared  with  this  base  line  information  to  identify  trends 
or  changes  in  users'  needs  and  requirements.  Identifying  all 
surveys  distributed  with  serial  numbers  or  codes  and  keeping 
accurate  records  of  how  many  went  to  each  user  will  begin  to 
solve  many  of  the  problems  this  researcher  encountered.  Also 
by  use  of  the  records,  second  and  third  requests  to  non- 
respondents  tor  completion  of  the  survey  can  be  effectively 
administered.  Istablish  firm  deadlines  for  survey  return  and 
use  direct  questions  which  require  the  user  to  make  a  decision. 
Do  not  structure  questions  which  have  answers  that  are  vague 
or  can  define  the  complete  set  of  responses.  Include  more 
questions  identifying  the  user  (OOP,  non-DOD),  and  always 
allow  respondent*,  to  remain  anonymous  to  eliminate  the  doubts 
.  reprisal  and  better  collect  honest  opinions.  Some  specific 
items  to  include  in  the  follow-up  study  should  be: 

1.  Questions  about  short  reports  or  executive  summaries. 
Z.  A  larger  number  of  categories  with  which  respondents 
can  identify  (training,  collection,  POP,  non-POP) 

3.  A  maximum  use  of  interval  variables,  eliminating 
all  possible  ambiguous  answers. 
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4.  Questions  requesting  the  user  to  evaluate  FTD 
services  relative  to  those  of  other  agencies  in 
the  intelligence  community. 

lhe  intormation  gained  m  this  study  has  provided  pro¬ 
tiles  ot  sped  lie  users  ol  III)  products.  These  profiles  can 
now  be  integrated  into  the  production  process  to  tailor  docu¬ 
ments  to  spec  it  ic  clients.  Tins  saves  time  and  energy  as  well 
as  provides  the  customer  w  1 1  h  exactly  what  he  1  requesting. 
Communication  is  a  key  to  the  performance  ability  of  a 
marketing  department.  This  market  study  has  helped  ITU  to 
know  clients  better  and  has  let  these  clients  know  that  FTP 
cares  about  their  needs. 
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19 

5.0 

CISC,  1 uropean  Command 

24 

5.7 

loint  Chiefs  of  Staff 

5 

0.8 

loint  Strategic  Target  Planning  Staff 

4 

0.6 

Navy 

8  2 

12.8 

office  of  the  Secretary  of  Defense 

16 

2.5 

Mi  see  1  la neons 

17 

2.6 

Missing 

12 

1.9 
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\ 


Which  category  nost  nearly  describes  the 
primary  mission  of  your  office? 


A. 

Policymaking,  Planning,  or  Decision* 
mak 1 ng 

9.8 

B . 

Research  and  Development  (R5D) 

21.4 

C. 

Military  Operations 

9.0 

D. 

I nt e 1  l  igence 

SS.  3 

K . 

Ot  he  r 

3.4 

F. 

Missing 

1  . 1 

Indicate  the  importance  to  your  office 

Short 

Mid- to- Long 

of 

the  following  functional  areas  of 

Term  \ 

Term  3 

Sf,T 

i nt e 1 1 igence . 

V. 

Offensive  ballistic  missile  systems 
and  subsystems 

Very  important 

21.7 

20.5 

Moderate  1 y  impor tant 

12.0 

13.7 

somewhat  important 

22.5 

21.3 

Un import  ant 

33.9 

34.2 

Missing 

9.0 

10.4 

B. 

Ballistic  missile  facilities  and 
equ  i pm  e n t 

Very  important 

11.6 

11.6 

Moderately  important 

13.5 

13.4 

Somewhat  important 

23.8 

22.8 

Unimportant 

39.9 

40.2 

Missing 

11.2 

12.0 

C  . 

lighter  aircraft  systems  and 
subsy  s  t  ems 

Very  important 

45.5 

40.4 

Moderately  important 

17.4 

18.8 

Somewhat  important 

12.4 

13.7 

Unimportant 

16.3 

17.7 

Missing 

8.4 

9.5 

D. 

Bomber  aircraft  systems  and 
subsystems 

Very  important 

34.0 

31.4 

Moderately  important 

22.5 

21.0 

Somewhat  important 

16.9 

18.8 

Unimportant 

18.2 

19.6 

Missing 

8.4 

9.3 
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Quest  ion 


Short  Mid- to- Long 
Term  \  Term  \ _ 


3.  K.  llec t ro- opt ica 1  systems 


Very  important  28.0 
Moderately  important  25.8 
Somewhat  important  20.5 
Unimportant  18.2 
Missing  7.6 


l. .  Preliminary  aircraft  design 


Very  important  9.9 
Moderately  important  14.1 
Somewhat  important  23.3 
Unimportant  40.4 
Missing  12.3 


M.  Preliminary  aerodynamic  missile 
des i gn 


Very  important  11.0 
Moderately  important  14.9 
Somewhat  important  21.7 
Un i mpo r  t  ant  40.5 
Missing  11.8 


S.  Preliminary  ballistic  and  space 
vchu  1  c  de  sign 


Very  import  ant  9 . 5 
Moderately  important  8.7 
Somewhat  important  18.8 
Uni mpor  t  ant  51.4 
Missing  11.6 

O.  \pplted  aerospace  technologies 

Very  important  10.4 
Moderately  important  16.8 
Somewhat  important  30.6 
Un import  ant  31.4 
Missing  10.9 

P.  Directed  energy  technologies  and 
systems 

Very  important  IS.  5 
Moderately  important  15.1 
Somewhat  important  23.4 
Unimportant  36.0 
Missing  9.9 


27.0 

24.2 
21.9 

18.2 
8.7 


11.0 

14.3 

21.1 

41.3 

12.3 


12.9 

13.8 

20.0 

41.0 

12.3 


9.8 

9.0 

16.8 

51.9 

12.6 


11.0 

16.6 

28.3 

32.9 

11.2 


19.3 

13.4 
23.0 
33.9 
10.6 


9  3 


Short 

est ion  Term  \ 

Q .  Advanced  systems  research,  develop¬ 
ment  and  test  facilities 

Very  important  11.6 

Moderately  important  18.0 

Somewhat  important  29.8 

Unimportant  SO. 7 

Missing  9.8 

R.  Aerospace  technologies  research 

Very  important  9.3 

Moderately  important  16.0 

Somewhat  important  26.6 

Unimportant  3S.7 

Missing  12.4 

S.  Command,  control  (,  telecommunications 

Very  important  34.0 

Moderately  important  24.4 

Somewhat  important  19.4 

Unimportant  13.7 

Missing  8.S 

T.  Integrated  warfare  systems  threat  - 
current  and  future 

Very  important  39.0 

Moderately  important  20.7 

Somewhat  important  14.8 

Unimportant  1S.1 

Missing  10.6 


U.  Integrated  electromagnetic  systems  - 
current  and  future 


Very  important  2S.3 
Moderately  important  23.8 
Somewhat  important  18.2 
Unimportant  21.4 
Missing  11.3 

V.  CW  6  C'1  threat  simulator  validation 

Very  important  24 . S 
Moderately  important  17.4 
Somewhat  important  18.3 
Unimportant  29.2 
Missing  10.6 


Mid- to- Long 
Term  1 


13.0 

17.2 
28.1 

31 . 2 
10.4 


1 1  .  S 
IS.  1 
25. 9 
35.  1 
12.4 


31.4 
23.  1 
19.9 
15.8 
9.8 


35.6 
22.4 
14.9 
IS. 8 


23.9 
21.6 
19.4 

21.9 


23.8 

15.5 

18.8 
30.3 

11.6 
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Quest  ion 

3.  W.  Meteorological  Sciences 


Short  Mid-to-Long 
Term  t  Term  I _ 


Very  important 

5.0 

4.0 

Moderately  important 

9.6 

10.1 

Somewhat  important 

23.0 

22.4 

Unimportant 

SI  .2 

51.2 

M  i  s  s  i  n  g 

11.2 

12.3 

Indicate  the  importance  to  your  office 

of 

the  following  kinds  of  intelligence? 

A. 

Intelligence  1  vent 

Very  important 

33.  1 

25.3 

Moderate  1 y  impo rt ant 

24  .  4 

22.2 

Somewhat  important 

20.2 

21.6 

Un  import  an t 

15.5 

22.2 

Missing 

6 . 8 

8.7 

B. 

Intelligence  Target 

Very  important 

2  3.1 

18.8 

Moderately  important 

18.9 

18. S 

Somewhat  important 

20.3 

20.8 

Un  important 

28.0 

30.7 

Missing 

9.6 

11.2 

C. 

B iog  raph ica 1 /Organ i za  t lona 1 

Very  important 

8 . 9 

7.5 

Moderately  important 

14.1 

13.0 

Somewhat  important 

32.0 

29.0 

Unimportant 

33.7 

37.7 

Missing 

11.3 

12.7 

n. 

Basic  Technologies  Research  and 
Development 

Very  important 

14.1 

17.5 

Moderately  important 

24.7 

21.3 

Somewhat  important 

32.1 

30.3 

Unimportant 

21 . 1 

22.7 

Missing 

7.9 

8.5 

t. 

Military  Doctrine  fi  Design  Philosophies 

Very  important 

21.4 

21.0 

Moderately  important 

28.6 

25.8 

Somewhat  important 

26.2 

26.1 

Unimportant 

14.4 

16.5 

Missing 

9.3 

10.7 
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Short  Mid -to -Long 
Term  \  Term  l 


F. 

Ingi nee  ring  U  Production  Technologies 

i 

Very  important 

12.  6 

13.5 

Moderately  important 

19.9 

18.3 

Somewhat  important 

29.0 

27.2 

Un import  ant 

27 . 8 

29.3 

Miss  ing 

10.7 

11.6 

G. 

Weapon  Subsystem  Performance,  Charac¬ 
teristics  and  Capabilities 

Very  important 

4  b .  6 

41.1 

Moderately  important 

21.1 

22.  5 

Somewhat  important 

15.5 

14.9 

Un impor t ant 

9.  5 

12.3 

Missing 

7  .  5 

9.2 

ii. 

Weapon  System  Performance,  Charac¬ 
teristics  and  Capabilities 

Very  important 

57. b 

51 .  2 

Moderately  important 

20.2 

20.7 

Somewhat  important 

9.3 

12.0 

Un 1 mpo  r  t  an  t 

7.0 

9.3 

Missing 

5.9 

6.8 

I  . 

Integrated  Warfare  Systems  Threat 

A ssessmen t  s 

Very  important 

4b.  1 

40.5 

Moderately  important 

20.2 

20.3 

Somewhat  important 

IS.  7 

18.0 

Un important 

10.6 

11. 5 

Missing 

7.5 

9.6 

Indicate  the  importance  of  the  following 
degrees  of  intelligence  analysis. 

t 

A. 

Unana lyied 

Very  important 

18.8 

Moderately  important 

17.5 

Somewhat  important 

32.0 

Unimportant 

28.0 

'*i  ss  i  ng 

3.7 

B. 

Partially  Analyzed 

Very  important 

26.6 

Moderately  important 

37.1 

Somewhat  important 

21.3 

Un  important 

11.3 

Missing 

3.7 

Quest  ion  _ \ 


5.  C.  Fully  Analyzed 

Very  important  70.0 
Moderately  important  18.2 
Somewhat  important  7.8 
Unimportant  2.0 
Missing  2.0 


6.  Indicate  the  importance  of  the  follow-  Short  Mid-to-long 
ing  reporting  formats.  Term  \  Term  l _ 

A.  In- depth.  Comprehensive  Study 


\ery  important 
Moderately  important 
Somewhat  important 
Unimportant 
Miss ing 
IJn  familiar 


40.4 

40.4 

22.4 

20.8 

16.6 

14.8 

S .  3 

4.0 

6.4 

8.  S 

9.0 

1 1 .  S 

B.  V. capon  System  MandbooV 

Very  important 
Moderately  important 
Somewhat  important 
Wn important 
Missing 
Un  fam i 1 i a  r 


49.7 

46.4 

25.6 

25.2 

8.7 

7.5 

4 . 8 

3.7 

4.7 

8.  S 

6.5 

8.7 

C.  Weapon  System  Acquisition  Threat 
Package 


\ery  important 
Moderately  important 
Somewhat  important 
Unimportant 
Mi ss ing 
Unfamiliar 


23.1 

24.1 

21.6 

21.0 

13.7 

10.6 

8.9 

7.0 

9.3 

9.0 

23.4 

28.4 

P.  Short  Report  on  a  Specialized 
Subject 

Very  important 
Moderately  important 
Somewhat  important 
Unimportant 
Missing 
Unfamiliar 


33.4  32.8 

27.8  26.9 

20.2  17.7 

4 . S  4.7 

S.O  6.7 

9.2  11.3 
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Quest  ion 

Short 
Term  \ 

Mid-  to-  I.ong 
Term  l 

6.  1  .  Computer  Uata  Base 

Very  important 

8.9 

13.0 

Moderately  important 

11.6 

11.3 

Somewhat  important 

18.6 

15.8 

Unimportant 

25 . 9 

17.5 

Missing 

10.6 

7.1 

Unfami  liar 

24 . 4 

35.1 

l .  Brie! inn  by  an  ITU  Analyst 

Wry  important 

18.2 

19.  7 

Moderately  important 

17.5 

18.0 

Somewhat  important 

19.5 

18.0 

Unimportant 

16.8 

10.1 

Mi ss i ng 

8 . 9 

6.8 

Unfam i 1 iar 

19.4 

27.3 

Indicate  the  importance  to  your 
the  various  means  by  which  ITU 

office  of 
d i s semi  nates 

intel  1  igence . 

A.  Courier  or  Mail 

Very  important 

48.3 

43.5 

Moderately  important 

24  .  2 

24.2 

Somewhat  important 

12.3 

12.7 

Unimportant 

6.7 

7.6 

Missing 

8.  S 

12.0 

B.  Ilectrical  Transmission 

Very  important 

31.2 

30.4 

Moderately  important 

22.5 

24.5 

Somewhat  important 

13.8 

12.1 

Un important 

20.7 

20.5 

Missing 

11.8 

12.4 

C.  Briefer's  Presentation 

Very  important 

16.6 

16.9 

Moderately  important 

17.9 

18.8 

Somewhat  important 

21.7 

22.0 

Unimportant 

31. S 

29.7 

Missing 

12.3 

12.6 
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>uos  t  i  on 


Short  Mid  -  to  -  Long 
Term  l  Term  3 


l>.  On-Line  Computer  1.  ink 


Very  important 

8.1 

15.2 

Moderately  important 

6.4 

9.5 

Somewhat  important 

9.3 

11.2 

Un l mport a nt 

58.9 

49.5 

Missing 

17.4 

14.6 

Off  Line  Computer  Tape 

Very  important 

3.4 

5.7 

Mode ra t c 1 y  i mpor t an t 

6 . 4 

10.4 

Somewhat  important 

10.1 

12.9 

llti  i  mpo  rt  ant 

62.2 

5b.  1 

Mi  ss i ng 

18.0 

14.9 

L.  off-i.jne  Computer  Printout 


Very  important 

5.3 

7.8 

'lode  ra  t  e  1  y  import  ant 

9.0 

13.2 

Somewhat  important 

14.8 

15.5 

Un import  ant 

53.8 

49.3 

Missing 

17.2 

14.3 

).  In  what  intelligence  timetrame  does 

your  office  require  SfiT  intelligence?  _ 1 


Near  rea 1 t ime  39.1 
0- 2  year s  28.9 
2  -  5  year s  9  .  S 
S-10‘ years  12.7 
1 0- 1 S  years  3.4 
15-20  years  1 .  1 
Beyond  20  years  .6 
Missing  4.7 


).  Mow  does  your  office  obtain  intelligence 
informat  ion? 


This  office  extracts  information  from 


intelligence  products  59.5 
Xnother  office  provides  intelligence  24.1 
Other  14.1 
Missing  2.3 


r*  l/i  M  wA  O 


M 


Quest  ion  _ \ 


how  much  reaction  time  Jo  you  have? 

One  hour  or  less  5.9 

Within  several  hours  7.1 

One  Jay  6.4 

A  tev>  Jays  to  one  week  50.9 

One  mont h  9.5 

One  to  n  months  7.6 

More  than  6  months  -8 

Va r i es  51.1 

Missing  5.0 

15.  How  frequently  does  your  office  use  aerospace 
Sf,T  intelligence? 

Daily  25.4 

Several  times  a  week  22.8 

Once  a  week  15.5 

Monthly  or  less  frequently  54.5 

Never  2.5 

Missing  1.2 

14.  How  important  l  s  information  on  the  methodology 
used  by  1  ID  to  your  office” 

Not  i mpo  rtant  57.1 

Somewhat  important  26.2 

Moderately  important  18.5 

Very  important  16.9 

Missing  1.2 

15.  Does  your  office  have  a  working  knowledge  of 
the  Intelligence  Production  Requirements  (IPR) 
system  (DP  lorn  149? )? 

Yes  56.6 

No  60.6 

Missing  2.8 

19.  Is  it  necessary  for  your  office  to  perform 
additional  anal  vs  is  on  the  Sf,l  intelligence 
you  receive  in  order  to  satisfy  your  needs? 

No  4  2.8 

Yes,  integrate  with  other  data  47.7 

Yes,  for  other  reasons  7.8 

Missing  1.7 
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Quest  ion  _ l 

22.  Indicate  the  importance  to  your  ol ' ice 

of  the  S fi  1  intelligence  you  now  work  with 
to  each  of  the  following  1 ntell igence 
app 1 icat ions . 

Preparing  studies  and  briefings  for 
pol icymakers 


Very  important  28. 6 
Moderately  important  14.1 
Somewhat  important  13.7 
Unimportant  33.7 
Missing  9.9 

H.  Preparing  studies  and  briefings  for  planners 

Very  important  25.6 
Moderately  important  18.3 
Somewhat  important  17.7 
Un i mpor t ant  27.6 
Missing  10.7 

(' .  Preparing  studies  and  briefings  for 
military  staffs 

Very  important  28.1 
Moderately  important  21.1 
Somewhat  important  16.8 
Unimportant  23.3 
Missing  10.7 

n.  Prepaiing  briefings  lor  aircrews 

Very  important  13. 
Moderately  important  8. 
Somewhat  important  7. 
Unimportant  59. 
Missing  12. 

b.  Conducting  other  military  operations 

Very  important  7. 
Moderately  important  10. 
Somewhat  important  14. 
Unimportant  S3. 
Missing  13. 
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I  ,  RDTfil  oi  ll. S.  equipment 


Very  important  25.0 

Moderately  important  11.5 

Somewhat  important  7.9 

Unimportant  47. 

Missing  10. 

li .  Procuring  U.S.  equipment 

Very  important  12.4 

Moderately  important  10.1 

Somewhat  important  9.6 

Un i mpo r t  ant  5  5.4 

Missing  12.4 

II.  Integration  into  intelligence  studies 

\  cry  import  ant  21.6 

Moderately  important  17.9 

Somewhat  important  15.4 

Un  tmpo r  t  an t  5  4.9 

Missing  10.2 

I.  Developing  intelligence  threats 

Very  important  51.2 

Moderately  important  16.8 

Somewhat  important  14.6 

Unimportant  27.6 

Missing  9.8 

.1 .  Targeting  for  intelligence  collection 

Very  important  15.7 

Moderately  important  15.0 

Somewhat  important  12.9 

Unimportant  48.6 

Missing  11.8 

k.  Managing  crises 

Very  important  9.0 

Moderately  important  6.7 

Somewhat  important  12.7 

Unimportant  59.2 

Mi ss i ng  12.4 
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23. 

It  your  o  t  t  ice  uses  Ml)  -  produced  data,  has 

your  ofiice  communicated  with  the  producing 
oft  ice  within  I'M)  during  the  last  year? 

Ves 

40.7 

No 

56.  1 

M 1  s  t  rig 

3.3 

2t>. 

Does  youi  oil  lie  actual  In  use  ! TP ■ produced 
doc  umen  t  ’ 

i  es 

6  2.0 

No 

31  .  1 

MisM  ng 

7.0 

AIM’!  MUX  ( 

Sample  Mean  Comparisons  of  Current  Versus 
future  Importance  lor  functional  Areas  of 
Intelligence,  Kinds  of  Intelligence, 
Reporting  formats,  and  Dissemination  Mean 


AITINDIX  C 


Sample  Moan  comparisons  of  Current  Versus 
Future  Importance  for  Funct  lona  1  A re a_s  o  1 
J_n  t  e  1  1  itjencc  ,  Kinds  of  Intel  1  lgcnc e  , 

Report in£  Fotiltl,  and  Dissemination  Means 

I  he  following  tables  compare  the  sample  means  of 
current  versus  future  responses  for  Questions  2,  3,  4,  t>  ami 
on  the  1  ID  user’s  survey. 

Ihe  same  uul  i v  idua 1  was  evaluated  for  his  current  and 
future  responses  by  use  of  a  paired  t  test.  The  correlation 
between  all  comparisons  of  current  and  future  was  positive, 
making  the  use  of  paired  samples  effective.  ixtrancous 
influences  on  the  variable  that  was  measured  were  reduced  by 
the  use  of  pairing.  The  number  of  cases  varies  from  question 
to  question  because  respondents  who  did  not  answer  both  the 
current  and  future  parts  of  any  one  topic  were  eliminated  for 
t  hat  part i cular  test. 

The  Student’s  t-test  was  used  to  evaluate  the  data. 
Responses  were  coded  arbitrarily  as: 

1  •  Very  Important 

2  ■  Moderately  Important 

3  «  Somewhat  Important 

4  ■  Not  Important 

This  scoring  technique  required  the  quantification  of  subjective 


preferences,  which  is  inherently  risky.  It  should  he  realized 
that  the  scale  is  at  best  ordinal  in  nature;  however,  the 
large  sample  size  and  comparison  of  two  equally  structured 
scales  allow  the  use  of  statistical  techniques  without  loss 
ot  accuracy.  Relative  differences  were  the  only  meaningful 
tacts  utilized. 
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Jesse  F.  Jenkins,  Jr.  was  horn  in  San  Antonio,  Texas 


on  January  12,  1948.  He  graduated  from  Highlands  High  School 
in  San  \ntonio  in  1966  and  from  the  University  of  Texas  at 
Austin  in  1970  with  a  Bachelor's  Degree  in  Mathematics. 

After  attending  Officer  Training  School,  he  went  to 
Mather  Air  Force  Base,  California  for  Undergraduate  Navigator 
Training  and  received  his  wings  on  25  August  1972.  His  first 
operational  assignment  was  in  the  C-150  aircraft  at  1’ope  Air 
Force  Base,  North  Carolina.  During  his  tour  there,  he  upgraded 
to  Instructor  Navigator  and  Squadron  Standardization  and 
I  valuation  Officer.  One  of  his  many  assignments  while  at 
Pope  Air  Force  Base  was  in  support  of  the  return  of  the  POK's 
and  their  flight  out  of  Hanoi.  He  was  later  transferred  to 
Iglin  AFB  as  a  Fire  Control  Officer  on  the  AC-150  in  October 
1975.  The  summer  of  1976  he  attended  Squadron  Officers  School 
at  Montgomery,  Alabama.  He  became  King  Scheduling  Officer  for 
the  gunships  in  1977  and  was  awarded  a  Regular  Air  Force 
commission.  Captain  Jenkins  was  then  assigned  to  the  Air  Force 
Institute  of  Technology  in  June,  1978. 

Captain  Jenkins  is  married  to  the  former  Patsy  Louise 
Davis  of  San  Antonio,  Texas.  They  have  one  daughter,  Tracy  Dawn 

Permanent  Address:  2644  Kalcetka 

San  Antonio,  Texas  78210 


